[ 1334.433986] env[71051]: INFO neutron.common.config [-] Logging enabled! [ 1334.434247] env[71051]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev83 [ 1334.434495] env[71051]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71051) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 1334.434823] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 1334.435072] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 1334.435742] env[71051]: WARNING oslo_policy.policy [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 1334.436481] env[71051]: WARNING oslo_policy.policy [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 1334.437512] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] VMware NSXv3 Agent initialized successfully. [ 1334.437858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Acquiring lock "singleton_lock" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.437994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Acquired lock "singleton_lock" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.438242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Releasing lock "singleton_lock" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.438567] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Full set of CONF: {{(pid=71051) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 1334.438747] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ******************************************************************************** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 1334.438876] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Configuration options gathered from: {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ================================================================================ {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] agent_down_time = 75 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] allow_automatic_dhcp_failover = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.439884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] allow_bulk = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440111] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] api_extensions_path = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440210] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] api_paste_config = api-paste.ini {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440328] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] auth_strategy = keystone {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440869] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] backdoor_port = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440869] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] backdoor_socket = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440869] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] backlog = 4096 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.440869] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] base_mac = fa:16:3e:00:00:00 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441038] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] bind_host = 0.0.0.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441566] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] bind_port = 9696 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441566] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] client_socket_timeout = 900 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441566] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] config_dir = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441566] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441718] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] config_source = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.441884] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] control_exchange = neutron {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442539] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] core_plugin = ml2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442539] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] debug = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442539] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] default_availability_zones = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442539] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442698] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dhcp_agent_notification = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442799] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dhcp_agents_per_network = 1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.442885] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dhcp_lease_duration = 86400 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443086] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dhcp_load_type = networks {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443185] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dns_domain = openstacklocal {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443326] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443463] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_default_route_bfd = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443596] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_default_route_ecmp = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443826] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_dvr = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443909] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_new_agents = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.443991] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_services_on_agents_with_admin_state_down = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_signals = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] enable_traditional_dhcp = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] external_dns_driver = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] filter_validation = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] global_physnet_mtu = 8950 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] graceful_shutdown_timeout = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446354] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] host = cpu-1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] host_dvr_for_dhcp = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] http_retries = 3 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] instance_format = [instance: %(uuid)s] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ipam_driver = internal {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ipv6_pd_enabled = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446651] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] l3_ha = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] l3_ha_network_physical_name = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] l3_ha_network_type = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_color = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_config_append = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446831] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.446987] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_dir = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447136] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_file = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447171] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_options = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447291] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_rotate_interval = 1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447435] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_rotate_interval_type = days {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447574] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] log_rotation_type = none {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447682] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447787] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.447929] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448077] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448185] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448419] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_dns_nameservers = 5 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448567] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_header_line = 16384 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448707] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_l3_agents_per_router = 3 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448846] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_logfile_count = 30 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.448989] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_logfile_size_mb = 200 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.449139] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] max_subnet_host_routes = 20 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] my_ip = 10.180.1.21 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] my_ipv6 = ::1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] network_auto_schedule = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] network_link_prefix = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.450202] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] notify_nova_on_port_data_changes = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] notify_nova_on_port_status_changes = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] pagination_max_limit = -1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] publish_errors = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rate_limit_burst = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rate_limit_except_level = CRITICAL {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rate_limit_interval = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452235] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] retry_until_window = 30 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] router_distributed = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rpc_resources_processing_step = 20 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rpc_response_max_timeout = 600 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] rpc_response_timeout = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] send_events_interval = 2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] service_plugins = ['router'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452417] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] setproctitle = on {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452587] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] shell_completion = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452587] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] state_path = /opt/stack/data/neutron {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452587] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] syslog_log_facility = LOG_USER {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452587] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] tcp_keepidle = 600 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452587] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] transport_url = **** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452717] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] use_journal = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452913] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] use_json = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.452973] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] use_ssl = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453121] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] use_stderr = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453285] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] use_syslog = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453402] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vlan_qinq = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453536] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vlan_transparent = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453735] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] watch_log_file = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.453825] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] wsgi_default_pool_size = 100 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.454612] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] wsgi_keep_alive = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.454612] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.454612] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] wsgi_server_debug = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 1334.454612] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_concurrency.disable_process_locking = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.454612] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.connection_string = messaging:// {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455731] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.enabled = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455731] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.es_doc_type = notification {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.455942] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.es_scroll_size = 10000 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456022] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.es_scroll_time = 2m {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456742] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.filter_error_trace = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456742] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.hmac_keys = **** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456742] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.sentinel_service_name = mymaster {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456742] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.socket_timeout = 0.1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.456742] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.trace_requests = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457027] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler.trace_sqlalchemy = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457027] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler_jaeger.process_tags = {} {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457124] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler_jaeger.service_name_prefix = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457255] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] profiler_otlp.service_name_prefix = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457406] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.enforce_new_defaults = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457677] env[71051]: WARNING oslo_config.cfg [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 1334.457830] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.enforce_scope = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.457976] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.policy_default_rule = default {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458144] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458670] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458670] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458670] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458849] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.458849] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_policy.remote_timeout = 60.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] agent.extensions = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.459959] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] service_providers.service_provider = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460196] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.default_quota = -1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460196] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460196] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_floatingip = 50 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460334] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_network = 100 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460759] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_port = 500 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460759] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_rbac_policy = 10 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460759] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_router = 10 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.460893] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_security_group = 10 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.461038] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_security_group_rule = 100 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.quota_subnet = 100 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] QUOTAS.track_quota_usage = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463135] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463386] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_dhcp_release.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463569] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463569] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463569] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463569] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463788] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463902] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_ovs_vsctl.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.463983] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.capabilities = [21] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464129] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464266] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464410] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464554] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464690] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_namespace.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464836] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.capabilities = [12] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.464973] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465619] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465619] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465619] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465619] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_conntrack.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465855] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.capabilities = [12, 21] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465855] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.group = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.465961] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.helper_command = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.466142] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.466298] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.thread_pool_size = 8 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.466437] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] privsep_link.user = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.466599] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467072] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467072] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.continue_on_failed_promotions = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467072] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.dscp = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467295] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.dscp_inherit = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467348] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.force_mp_to_policy = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467473] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.locking_coordinator_url = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467614] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.log_agent_heartbeats = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467935] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.logging_expire = 1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.467935] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468091] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468200] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.polling_interval = 240 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468752] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468752] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.quitting_rpc_timeout = 120 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468752] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.report_interval = 30.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468882] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.468970] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469344] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469344] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.sync_skew = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469447] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.synchronization_queue_size = 20 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469846] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT.use_helper_for_ns_read = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469846] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] SECURITYGROUP.enable_ipset = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.469846] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] SECURITYGROUP.enable_security_group = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470575] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470575] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470575] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] experimental.ipv6_pd_enabled = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470575] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.extension_drivers = ['port_security'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470575] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.external_network_type = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470777] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.470881] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.overlay_ip_version = 4 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471039] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.path_mtu = 8950 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471317] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.physical_network_mtus = {} {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471391] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.tenant_network_types = ['vlan'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471480] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471902] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ml2.type_drivers = ['vlan'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.471902] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT_CLI.neutron_port_id = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472009] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472096] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472247] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472395] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472919] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472919] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.472919] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473113] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473174] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473318] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_login_password = **** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473733] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_login_port = 443 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473733] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_login_user = admin {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473733] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.473897] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474037] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474179] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474324] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474633] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474633] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.474764] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475318] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475318] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475318] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475508] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475508] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475669] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475833] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vsphere.vsphere_login_password = VMware1! {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.475981] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476140] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476287] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.auth_section = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476442] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.auth_type = password {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476589] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476732] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.certfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.476874] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.collect_timing = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477034] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.endpoint_type = public {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477179] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.insecure = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477317] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.keyfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477462] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.region_name = RegionOne {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477603] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.split_loggers = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477743] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] nova.timeout = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.477887] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.auth_section = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478044] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.auth_type = password {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478193] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478329] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.certfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478471] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.collect_timing = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478616] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.endpoint_type = public {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478758] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.insecure = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.478893] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.keyfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479037] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.region_name = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479179] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.split_loggers = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479317] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] placement.timeout = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479462] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.auth_section = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479606] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.auth_type = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479745] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.cafile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.479882] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.certfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480032] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.collect_timing = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480173] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.connect_retries = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480311] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.connect_retry_delay = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480449] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.enable_notifications = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480614] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.endpoint_override = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480766] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.insecure = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.480906] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.interface = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481055] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.keyfile = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481194] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.max_version = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481331] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.min_version = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481467] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.region_name = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481622] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.retriable_status_codes = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481772] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.service_name = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.481909] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.service_type = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482067] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.split_loggers = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482207] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.status_code_retries = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482344] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.status_code_retry_delay = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482483] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.timeout = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482621] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.valid_interfaces = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482758] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ironic.version = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.482934] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] cli_script.dry_run = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483103] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483247] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483392] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483535] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483676] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483817] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.483957] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484158] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484251] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484447] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484534] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484682] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484829] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.484972] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485125] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485275] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485418] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485561] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485710] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485852] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.485997] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486152] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486296] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486436] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486579] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486722] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.486860] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487060] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487146] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487288] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487429] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487577] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487715] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487855] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.487999] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488156] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.ssl_version = {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488298] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488445] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_notifications.driver = [] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488588] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_notifications.retry = -1 {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488743] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488882] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] oslo_messaging_notifications.transport_url = **** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 1334.488995] env[71051]: DEBUG oslo_service.backend.eventlet.service [None req-3ce440a0-26f0-418b-9382-03af967d8f5e None None] ******************************************************************************** {{(pid=71051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 1334.489987] env[71051]: DEBUG neutron.agent.securitygroups_rpc [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Init firewall settings (driver=nsxv3) {{(pid=71051) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 1334.491334] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=71051) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 1334.491624] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] RPC agent_id: nsxm-l-01a.corp.local [ 1334.493861] env[71051]: DEBUG dogpile.cache.region [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1334.493990] env[71051]: DEBUG dogpile.lock [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1334.494108] env[71051]: DEBUG dogpile.lock [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1334.494213] env[71051]: DEBUG dogpile.lock [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1334.494328] env[71051]: DEBUG dogpile.cache.region [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1334.494392] env[71051]: DEBUG dogpile.lock [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1334.494525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1334.519172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Session token - acquiring [ 1334.520733] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.520907] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.520995] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.521415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.532149] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.797302] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 1334.822998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1334.823195] env[71051]: DEBUG dogpile.cache.region [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Cache value generated in 0.329 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1334.823298] env[71051]: DEBUG dogpile.lock [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1334.823422] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Activating Policy API Provider. [ 1334.823627] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Looking for the default Infrastructure Rules. [ 1334.905021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Looking for the Default Layer3 Logged Drop Section. [ 1334.918961] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 1334.919465] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.919657] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.919791] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.920099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.920630] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.438875] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.940948] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.443159] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Inventory metadata is going to be refreshed. [ 1336.443475] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1337.254610] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.254946] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.254946] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.255263] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.267264] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1337.369826] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.370796] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1337.386834] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.387114] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.387114] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.387422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.387554] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.387706] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1337.387826] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1337.387982] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1337.410573] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.410792] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.410852] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.411107] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.411279] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.411421] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1337.430294] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.430534] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.430579] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.430822] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.430962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.431115] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1337.448218] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.448553] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.448696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.448892] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.449043] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.449191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1337.449305] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1337.449413] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1337.470434] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.470634] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.470728] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.470955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.471092] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.471226] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1337.471336] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1337.471445] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1337.489349] env[71051]: DEBUG networking_nsxv3.common.locking [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.489498] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.489630] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.489840] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.490060] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.490246] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1337.490362] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1337.490470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Inventory metadata have been refreshed. [ 1337.490690] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Dryrun:True. Metadata refresh completed. [ 1337.490819] env[71051]: DEBUG oslo_concurrency.lockutils [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Releasing lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.492447] env[71051]: INFO neutron.agent.agent_extensions_manager [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Loaded agent extensions: [] [ 1337.493182] env[71051]: DEBUG neutron_lib.callbacks.manager [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=71051) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 1337.559969] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent RPC Daemon Started! [ 1337.560182] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:0 started [ 1337.560243] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent out of sync with plugin! [ 1342.493391] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.493777] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.497365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.497693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.497693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.497947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.498148] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.000677] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.494082] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.494223] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.502715] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.004774] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1348.004956] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1348.694144] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.694448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.694448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.694642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.706926] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1348.707910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.708677] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1348.728596] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.728721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.728807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.728973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.729067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.729172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1348.729235] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1348.729309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1348.749142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.749339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.749413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.749576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.749709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.749818] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1348.768903] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.769113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.769253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.769459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.769599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.769733] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1348.797097] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.797337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.797337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.797532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.797622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.797748] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1348.797818] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1348.797914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1348.815258] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.815447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.815555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.815813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.815924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.816075] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1348.816169] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1348.816246] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1348.835855] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.836021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.836083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.836292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.836392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.836514] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1348.836588] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1348.836658] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1348.836723] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1348.836798] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 1348.836860] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1348.836915] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1348.837185] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1348.837251] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1348.837321] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1348.854557] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.855492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.855492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.855492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.855492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.855492] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1348.871292] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.871472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.871509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.871714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.871820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.903973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.255238] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b066fc30-d3eb-4a39-9d82-dc8ca5187b60 demo admin] Enqueued Resource ID: 7c4c0219-1de8-4196-8047-a2a2e97f2bdc with Priority: HIGHEST for action security_group_rules [ 1351.255819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c4c0219-1de8-4196-8047-a2a2e97f2bdc with Priority: HIGHEST for action security_group_rules [ 1351.256075] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c4c0219-1de8-4196-8047-a2a2e97f2bdc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.256192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c4c0219-1de8-4196-8047-a2a2e97f2bdc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.256260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c4c0219-1de8-4196-8047-a2a2e97f2bdc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.256500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c4c0219-1de8-4196-8047-a2a2e97f2bdc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.256574] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c4c0219-1de8-4196-8047-a2a2e97f2bdc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.778509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.778678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.778722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.778901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.778993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.779102] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c4c0219-1de8-4196-8047-a2a2e97f2bdc already deleted. [ 1351.779187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c4c0219-1de8-4196-8047-a2a2e97f2bdc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.257361] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.257717] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.258887] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.259147] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.260574] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.260970] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.261864] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.262222] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.263371] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.263654] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.984328] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fe49bc92-d69e-47c0-958e-d99cda153336 None None] Enqueued Resource ID: 090e4d75-fc3e-4790-b25e-f68818839f02 with Priority: HIGHEST for action port [ 1376.984592] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 090e4d75-fc3e-4790-b25e-f68818839f02 with Priority: HIGHEST for action port [ 1376.985191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-090e4d75-fc3e-4790-b25e-f68818839f02 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.985275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-090e4d75-fc3e-4790-b25e-f68818839f02" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.985340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-090e4d75-fc3e-4790-b25e-f68818839f02" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.985575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-090e4d75-fc3e-4790-b25e-f68818839f02" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.985662] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('090e4d75-fc3e-4790-b25e-f68818839f02',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.488975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 090e4d75-fc3e-4790-b25e-f68818839f02 [ 1377.488975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.488975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.488975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.488975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.488975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.488975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:090e4d75-fc3e-4790-b25e-f68818839f02 already deleted. [ 1377.488975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-090e4d75-fc3e-4790-b25e-f68818839f02" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.886956] env[71051]: INFO networking_nsxv3.common.synchronization [None req-53dd37f2-561a-41bd-8bca-27df09e170ad None None] Enqueued Resource ID: d89e09b2-08ad-42a7-a769-fe40c49e4de1 with Priority: HIGHEST for action port [ 1378.887577] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89e09b2-08ad-42a7-a769-fe40c49e4de1 with Priority: HIGHEST for action port [ 1378.887850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d89e09b2-08ad-42a7-a769-fe40c49e4de1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.887974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d89e09b2-08ad-42a7-a769-fe40c49e4de1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.888056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d89e09b2-08ad-42a7-a769-fe40c49e4de1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.888339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d89e09b2-08ad-42a7-a769-fe40c49e4de1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.888408] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d89e09b2-08ad-42a7-a769-fe40c49e4de1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.395142] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d89e09b2-08ad-42a7-a769-fe40c49e4de1 [ 1379.395374] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.395518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.395598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.395807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.395902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.395999] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d89e09b2-08ad-42a7-a769-fe40c49e4de1 already deleted. [ 1379.396104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d89e09b2-08ad-42a7-a769-fe40c49e4de1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.867616] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a4d29855-e231-4cf3-8fe1-395714cd01a6 None None] Enqueued Resource ID: 21eaf708-b6e0-4f6e-84a5-392f7d6c08ad with Priority: HIGHEST for action port [ 1379.867616] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21eaf708-b6e0-4f6e-84a5-392f7d6c08ad with Priority: HIGHEST for action port [ 1379.867973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-21eaf708-b6e0-4f6e-84a5-392f7d6c08ad taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.868127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21eaf708-b6e0-4f6e-84a5-392f7d6c08ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.868175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21eaf708-b6e0-4f6e-84a5-392f7d6c08ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.868404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21eaf708-b6e0-4f6e-84a5-392f7d6c08ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.868481] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eaf708-b6e0-4f6e-84a5-392f7d6c08ad',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.372117] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21eaf708-b6e0-4f6e-84a5-392f7d6c08ad [ 1380.372395] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.372503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.372573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.372800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.372894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.372990] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21eaf708-b6e0-4f6e-84a5-392f7d6c08ad already deleted. [ 1380.373080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21eaf708-b6e0-4f6e-84a5-392f7d6c08ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.507421] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3234c37d-0cda-4c64-984e-d82f9e529cbf None None] Enqueued Resource ID: 82568e81-a9ca-4f58-b5ca-0066137fc7d3 with Priority: HIGHEST for action port [ 1381.507775] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82568e81-a9ca-4f58-b5ca-0066137fc7d3 with Priority: HIGHEST for action port [ 1381.508994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-82568e81-a9ca-4f58-b5ca-0066137fc7d3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.508994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82568e81-a9ca-4f58-b5ca-0066137fc7d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.508994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82568e81-a9ca-4f58-b5ca-0066137fc7d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.510066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82568e81-a9ca-4f58-b5ca-0066137fc7d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.511055] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82568e81-a9ca-4f58-b5ca-0066137fc7d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.929658] env[71051]: INFO networking_nsxv3.common.synchronization [None req-0132b18c-9a80-4d24-aac7-8401b044922c None None] Enqueued Resource ID: ebdbb0ee-0aad-42a4-869f-2f26a73e9847 with Priority: HIGHEST for action port [ 1381.929859] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdbb0ee-0aad-42a4-869f-2f26a73e9847 with Priority: HIGHEST for action port [ 1381.930559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebdbb0ee-0aad-42a4-869f-2f26a73e9847 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.930559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebdbb0ee-0aad-42a4-869f-2f26a73e9847" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.930680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebdbb0ee-0aad-42a4-869f-2f26a73e9847" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.930912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebdbb0ee-0aad-42a4-869f-2f26a73e9847" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.930975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebdbb0ee-0aad-42a4-869f-2f26a73e9847',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.012470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82568e81-a9ca-4f58-b5ca-0066137fc7d3 [ 1382.012716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.012820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.013590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.013590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.013590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.013590] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82568e81-a9ca-4f58-b5ca-0066137fc7d3 already deleted. [ 1382.013590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82568e81-a9ca-4f58-b5ca-0066137fc7d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.433654] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebdbb0ee-0aad-42a4-869f-2f26a73e9847 [ 1382.433654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.433846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.433846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.434053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.434147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.434244] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebdbb0ee-0aad-42a4-869f-2f26a73e9847 already deleted. [ 1382.434327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebdbb0ee-0aad-42a4-869f-2f26a73e9847" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.547101] env[71051]: INFO networking_nsxv3.common.synchronization [None req-531d6309-892f-4ce7-86d3-241ab24871f1 None None] Enqueued Resource ID: a84af80b-0429-4a5c-bfb0-877a4fa156a9 with Priority: HIGHEST for action port [ 1383.547408] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84af80b-0429-4a5c-bfb0-877a4fa156a9 with Priority: HIGHEST for action port [ 1383.548025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a84af80b-0429-4a5c-bfb0-877a4fa156a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.548291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a84af80b-0429-4a5c-bfb0-877a4fa156a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.548291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a84af80b-0429-4a5c-bfb0-877a4fa156a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.548396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a84af80b-0429-4a5c-bfb0-877a4fa156a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.548471] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a84af80b-0429-4a5c-bfb0-877a4fa156a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.592068] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e16e8136-0923-480c-82b8-4f253be27297 None None] Enqueued Resource ID: cdace743-5643-4f39-a9c0-b25705c6afe4 with Priority: HIGHEST for action port [ 1383.592547] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdace743-5643-4f39-a9c0-b25705c6afe4 with Priority: HIGHEST for action port [ 1383.593088] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdace743-5643-4f39-a9c0-b25705c6afe4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.593217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdace743-5643-4f39-a9c0-b25705c6afe4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.593289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdace743-5643-4f39-a9c0-b25705c6afe4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.593535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdace743-5643-4f39-a9c0-b25705c6afe4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.593619] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdace743-5643-4f39-a9c0-b25705c6afe4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.028454] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fb213126-d1f4-405a-a429-d34af97d5e27 None None] Enqueued Resource ID: 1909303b-3f4a-42d1-b207-fdb901f7638f with Priority: HIGHEST for action port [ 1384.030513] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1909303b-3f4a-42d1-b207-fdb901f7638f with Priority: HIGHEST for action port [ 1384.031865] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1909303b-3f4a-42d1-b207-fdb901f7638f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.032146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1909303b-3f4a-42d1-b207-fdb901f7638f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.032310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1909303b-3f4a-42d1-b207-fdb901f7638f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.032647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1909303b-3f4a-42d1-b207-fdb901f7638f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.033414] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1909303b-3f4a-42d1-b207-fdb901f7638f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.051547] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a84af80b-0429-4a5c-bfb0-877a4fa156a9 [ 1384.051777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.051899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.051964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.052414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.052414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.052414] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a84af80b-0429-4a5c-bfb0-877a4fa156a9 already deleted. [ 1384.052538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a84af80b-0429-4a5c-bfb0-877a4fa156a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.085212] env[71051]: INFO networking_nsxv3.common.synchronization [None req-390e9772-d93d-47eb-91f2-6e4b84ca3be5 None None] Enqueued Resource ID: 82b02d66-3d78-4efb-85c9-300dea73c612 with Priority: HIGHEST for action port [ 1384.085212] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b02d66-3d78-4efb-85c9-300dea73c612 with Priority: HIGHEST for action port [ 1384.085212] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b02d66-3d78-4efb-85c9-300dea73c612 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.085212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b02d66-3d78-4efb-85c9-300dea73c612" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.085212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b02d66-3d78-4efb-85c9-300dea73c612" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.085403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b02d66-3d78-4efb-85c9-300dea73c612" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.085403] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b02d66-3d78-4efb-85c9-300dea73c612',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.096443] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdace743-5643-4f39-a9c0-b25705c6afe4 [ 1384.096780] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.097457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.097549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.097759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.097966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.097966] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdace743-5643-4f39-a9c0-b25705c6afe4 already deleted. [ 1384.098112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdace743-5643-4f39-a9c0-b25705c6afe4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.534300] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1909303b-3f4a-42d1-b207-fdb901f7638f [ 1384.534570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.534693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.535078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.535078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.535078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.535205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1909303b-3f4a-42d1-b207-fdb901f7638f already deleted. [ 1384.535205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1909303b-3f4a-42d1-b207-fdb901f7638f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.589192] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82b02d66-3d78-4efb-85c9-300dea73c612 [ 1384.589192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.589192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.589192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.589192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.589192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.589192] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82b02d66-3d78-4efb-85c9-300dea73c612 already deleted. [ 1384.589192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b02d66-3d78-4efb-85c9-300dea73c612" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.393893] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b153ff65-56df-4b98-ba18-8b8fe277f317 None None] Enqueued Resource ID: b73c92d6-e5e4-4a01-95b6-bf74191b58ea with Priority: HIGHEST for action port [ 1385.395046] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73c92d6-e5e4-4a01-95b6-bf74191b58ea with Priority: HIGHEST for action port [ 1385.395046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b73c92d6-e5e4-4a01-95b6-bf74191b58ea taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.395046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b73c92d6-e5e4-4a01-95b6-bf74191b58ea" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.395046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b73c92d6-e5e4-4a01-95b6-bf74191b58ea" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.396415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b73c92d6-e5e4-4a01-95b6-bf74191b58ea" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.396415] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b73c92d6-e5e4-4a01-95b6-bf74191b58ea',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.463486] env[71051]: INFO networking_nsxv3.common.synchronization [None req-83f13d42-36a3-4f11-8e25-b4640692553d None None] Enqueued Resource ID: 9fe3b348-cacf-488e-b348-f822c76fb359 with Priority: HIGHEST for action port [ 1385.464502] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fe3b348-cacf-488e-b348-f822c76fb359 with Priority: HIGHEST for action port [ 1385.465556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fe3b348-cacf-488e-b348-f822c76fb359 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.465556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fe3b348-cacf-488e-b348-f822c76fb359" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.465556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fe3b348-cacf-488e-b348-f822c76fb359" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.465556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fe3b348-cacf-488e-b348-f822c76fb359" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.465556] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe3b348-cacf-488e-b348-f822c76fb359',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.899995] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b73c92d6-e5e4-4a01-95b6-bf74191b58ea [ 1385.899995] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.899995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.899995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.900347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.900347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.900347] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b73c92d6-e5e4-4a01-95b6-bf74191b58ea already deleted. [ 1385.900347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b73c92d6-e5e4-4a01-95b6-bf74191b58ea" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.970009] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fe3b348-cacf-488e-b348-f822c76fb359 [ 1385.970009] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.970009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.970009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.970009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.970009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.970009] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fe3b348-cacf-488e-b348-f822c76fb359 already deleted. [ 1385.970009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fe3b348-cacf-488e-b348-f822c76fb359" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.202018] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8be27aa2-c972-4e95-b3a9-80a0b22787e1 None None] Enqueued Resource ID: c613c7f8-1f99-4750-9a04-51aa281cd547 with Priority: HIGHEST for action port [ 1386.202310] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c613c7f8-1f99-4750-9a04-51aa281cd547 with Priority: HIGHEST for action port [ 1386.202865] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c613c7f8-1f99-4750-9a04-51aa281cd547 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.202989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c613c7f8-1f99-4750-9a04-51aa281cd547" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.203076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c613c7f8-1f99-4750-9a04-51aa281cd547" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.205269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c613c7f8-1f99-4750-9a04-51aa281cd547" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.205269] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c613c7f8-1f99-4750-9a04-51aa281cd547',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.691956] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a85d2fec-d49b-45ff-be6f-56076b5f3527 None None] Enqueued Resource ID: 2ad38942-7365-4c1e-84ce-2ebcf6dda52f with Priority: HIGHEST for action port [ 1386.691956] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad38942-7365-4c1e-84ce-2ebcf6dda52f with Priority: HIGHEST for action port [ 1386.692405] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ad38942-7365-4c1e-84ce-2ebcf6dda52f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.692542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ad38942-7365-4c1e-84ce-2ebcf6dda52f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.692755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ad38942-7365-4c1e-84ce-2ebcf6dda52f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.692885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ad38942-7365-4c1e-84ce-2ebcf6dda52f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.692933] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ad38942-7365-4c1e-84ce-2ebcf6dda52f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.709083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c613c7f8-1f99-4750-9a04-51aa281cd547 [ 1386.709083] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.709083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.709083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.709083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.709083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.709083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c613c7f8-1f99-4750-9a04-51aa281cd547 already deleted. [ 1386.709083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c613c7f8-1f99-4750-9a04-51aa281cd547" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.195398] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ad38942-7365-4c1e-84ce-2ebcf6dda52f [ 1387.196915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.196915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.196915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.196915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.196915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.196915] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ad38942-7365-4c1e-84ce-2ebcf6dda52f already deleted. [ 1387.196915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ad38942-7365-4c1e-84ce-2ebcf6dda52f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.594138] env[71051]: INFO networking_nsxv3.common.synchronization [None req-f0ec1f4a-db16-4b3c-b760-ba1d3c845cc9 None None] Enqueued Resource ID: 92220320-1229-4033-8fc8-59a92c9d781a with Priority: HIGHEST for action port [ 1387.594138] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92220320-1229-4033-8fc8-59a92c9d781a with Priority: HIGHEST for action port [ 1387.594138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-92220320-1229-4033-8fc8-59a92c9d781a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.594138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92220320-1229-4033-8fc8-59a92c9d781a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.594138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92220320-1229-4033-8fc8-59a92c9d781a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.594138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92220320-1229-4033-8fc8-59a92c9d781a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.594138] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92220320-1229-4033-8fc8-59a92c9d781a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.099195] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92220320-1229-4033-8fc8-59a92c9d781a [ 1388.099438] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.099592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.099663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.099952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.099952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.100106] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92220320-1229-4033-8fc8-59a92c9d781a already deleted. [ 1388.100152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92220320-1229-4033-8fc8-59a92c9d781a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.825657] env[71051]: INFO networking_nsxv3.common.synchronization [None req-08ebb00d-ed79-4a3f-a6d7-d33a87532fcf None None] Enqueued Resource ID: f1a8a643-b7fd-4839-b764-b30eef06caf9 with Priority: HIGHEST for action port [ 1388.825936] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a8a643-b7fd-4839-b764-b30eef06caf9 with Priority: HIGHEST for action port [ 1388.826363] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a8a643-b7fd-4839-b764-b30eef06caf9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.826469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a8a643-b7fd-4839-b764-b30eef06caf9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.826517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a8a643-b7fd-4839-b764-b30eef06caf9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.826914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a8a643-b7fd-4839-b764-b30eef06caf9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.826914] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a8a643-b7fd-4839-b764-b30eef06caf9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.112020] env[71051]: INFO networking_nsxv3.common.synchronization [None req-90664b1f-2cb1-445c-b082-5e473b14b03e tempest-ServersTestJSON-579992493 tempest-ServersTestJSON-579992493-project-member] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1389.112020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1389.112020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.112020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.112020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.112020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.112020] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.331631] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1a8a643-b7fd-4839-b764-b30eef06caf9 [ 1389.332154] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.332517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.332725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.333579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.333579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.333579] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1a8a643-b7fd-4839-b764-b30eef06caf9 already deleted. [ 1389.333579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a8a643-b7fd-4839-b764-b30eef06caf9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.359195] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a160e1be-1f24-4a0e-9d0f-374f2c0c6d8f tempest-ServersTestJSON-579992493 tempest-ServersTestJSON-579992493-project-member] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1389.359195] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1389.359195] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.359195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.519427] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c3b07383-a8c9-4fe0-b964-b8f8b16f8fb5 None None] Enqueued Resource ID: fe5ca761-82fa-450e-a185-81e570d087f2 with Priority: HIGHEST for action port [ 1389.519427] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5ca761-82fa-450e-a185-81e570d087f2 with Priority: HIGHEST for action port [ 1389.519427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe5ca761-82fa-450e-a185-81e570d087f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.520062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe5ca761-82fa-450e-a185-81e570d087f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.520193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe5ca761-82fa-450e-a185-81e570d087f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.520469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe5ca761-82fa-450e-a185-81e570d087f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.520694] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe5ca761-82fa-450e-a185-81e570d087f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.638103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.638440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.638665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.638764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.638898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.638998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d already deleted. [ 1389.639107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.639251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.639417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.639501] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.741079] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fbc97836-cb78-4fcd-8f7e-af6a301c09be tempest-ServersTestManualDisk-284606207 tempest-ServersTestManualDisk-284606207-project-member] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1389.741562] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1389.743520] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.743520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.743520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.743520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.743520] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.958843] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3bed2c49-5256-423a-b0ff-d3ed4635e0cc tempest-ServersTestManualDisk-284606207 tempest-ServersTestManualDisk-284606207-project-member] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1389.959457] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1389.961269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.961269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.025570] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe5ca761-82fa-450e-a185-81e570d087f2 [ 1390.025858] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.025955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.026015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.026222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.026315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.026414] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe5ca761-82fa-450e-a185-81e570d087f2 already deleted. [ 1390.026496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe5ca761-82fa-450e-a185-81e570d087f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.165316] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.165452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.165853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.165853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.165853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.165981] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d already deleted. [ 1390.166024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.267264] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.268353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.268569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.268885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.269345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.269566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b already deleted. [ 1390.269785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.270986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.270986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.270986] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.798861] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.798861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.798861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.798861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.798861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.798861] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b already deleted. [ 1390.798861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.631623] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a1a82518-8e52-4ad1-86fd-f247c8da3fb5 None None] Enqueued Resource ID: 98191534-ad22-4d5d-aca1-5e4ea26d1261 with Priority: HIGHEST for action port [ 1391.631889] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98191534-ad22-4d5d-aca1-5e4ea26d1261 with Priority: HIGHEST for action port [ 1391.632439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-98191534-ad22-4d5d-aca1-5e4ea26d1261 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.632554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98191534-ad22-4d5d-aca1-5e4ea26d1261" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.632619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98191534-ad22-4d5d-aca1-5e4ea26d1261" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.632867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98191534-ad22-4d5d-aca1-5e4ea26d1261" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.632946] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98191534-ad22-4d5d-aca1-5e4ea26d1261',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.902292] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4be04072-d1f7-4613-bf28-0de1b68d88db tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1391.902292] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1391.902855] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.902855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.902855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.903070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.903163] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.947205] env[71051]: INFO networking_nsxv3.common.synchronization [None req-bb91c45a-9bc7-4c90-8ab9-2c4a5a7c2646 None None] Enqueued Resource ID: df8a599c-8217-44e5-9218-50a9688f53f1 with Priority: HIGHEST for action port [ 1391.947461] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8a599c-8217-44e5-9218-50a9688f53f1 with Priority: HIGHEST for action port [ 1391.948150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-df8a599c-8217-44e5-9218-50a9688f53f1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.948150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df8a599c-8217-44e5-9218-50a9688f53f1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.948275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df8a599c-8217-44e5-9218-50a9688f53f1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.948752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df8a599c-8217-44e5-9218-50a9688f53f1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.948752] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df8a599c-8217-44e5-9218-50a9688f53f1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.109539] env[71051]: INFO networking_nsxv3.common.synchronization [None req-5d6891c4-9b7d-4ee3-935e-f3352229c53c tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1392.109539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1392.110144] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.110290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.138506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98191534-ad22-4d5d-aca1-5e4ea26d1261 [ 1392.138610] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.138834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.138959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.139314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.139506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.140074] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98191534-ad22-4d5d-aca1-5e4ea26d1261 already deleted. [ 1392.140074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98191534-ad22-4d5d-aca1-5e4ea26d1261" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.424734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.424956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.424956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.425177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.425261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.425348] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d already deleted. [ 1392.425472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.425574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.425726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.425839] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.442375] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8fdaa60d-e353-406b-963c-0a050bea3788 None None] Enqueued Resource ID: e6bb0f59-2006-4943-af06-d57aa43dab31 with Priority: HIGHEST for action port [ 1392.443155] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6bb0f59-2006-4943-af06-d57aa43dab31 with Priority: HIGHEST for action port [ 1392.443470] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6bb0f59-2006-4943-af06-d57aa43dab31 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.443683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6bb0f59-2006-4943-af06-d57aa43dab31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.443783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6bb0f59-2006-4943-af06-d57aa43dab31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.444084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6bb0f59-2006-4943-af06-d57aa43dab31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.444228] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6bb0f59-2006-4943-af06-d57aa43dab31',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.451475] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df8a599c-8217-44e5-9218-50a9688f53f1 [ 1392.451475] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.451475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.451475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.452259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.452259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.452468] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df8a599c-8217-44e5-9218-50a9688f53f1 already deleted. [ 1392.452533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df8a599c-8217-44e5-9218-50a9688f53f1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.946022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6bb0f59-2006-4943-af06-d57aa43dab31 [ 1392.947383] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.947383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.947383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.947383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.947383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.947383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6bb0f59-2006-4943-af06-d57aa43dab31 already deleted. [ 1392.947383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6bb0f59-2006-4943-af06-d57aa43dab31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.949285] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.949461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.949536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.949718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.949803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.949894] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d already deleted. [ 1392.949974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.539123] env[71051]: INFO networking_nsxv3.common.synchronization [req-45afd458-ebc2-4c6d-b086-a6820007fb4d req-bd2408b6-cf4e-41d9-a0a2-a142671a7404 tempest-FloatingIPsAssociationNegativeTestJSON-1679587902 tempest-FloatingIPsAssociationNegativeTestJSON-1679587902-project-member] Enqueued Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1393.539123] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1393.539123] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.539123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.539123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.539123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.539123] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.539123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.539123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.541106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.541346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.543288] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.045361] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.045361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.045361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.045361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.045361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.046653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.046653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.046653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.046653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.046653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.046653] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 already deleted. [ 1394.046653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.395387] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.395771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-695" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.395771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-695" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.396586] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-695" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.397288] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.397677] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.398265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.398500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.398736] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.399238] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1394.400318] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1394.400318] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1394.400318] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1394.400318] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1394.400318] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1394.400318] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1394.425016] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1394.425287] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1394.425404] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1394.425634] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-695" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.428782] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2a975c24-54e7-40b2-a669-805ea54026fc taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.428782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.428782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.428782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.428782] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a975c24-54e7-40b2-a669-805ea54026fc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.536322] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a670f7a0-9c46-4143-9ff4-e4acbd721be8 None None] Enqueued Resource ID: d3aa712c-b8eb-4aee-a74b-5ab4fb69f275 with Priority: HIGHEST for action port [ 1394.536529] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3aa712c-b8eb-4aee-a74b-5ab4fb69f275 with Priority: HIGHEST for action port [ 1394.537066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3aa712c-b8eb-4aee-a74b-5ab4fb69f275 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.537195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3aa712c-b8eb-4aee-a74b-5ab4fb69f275" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.537261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3aa712c-b8eb-4aee-a74b-5ab4fb69f275" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.537515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3aa712c-b8eb-4aee-a74b-5ab4fb69f275" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.537600] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3aa712c-b8eb-4aee-a74b-5ab4fb69f275',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.929657] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.929886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.930053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.930313] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.930457] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.930626] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2a975c24-54e7-40b2-a669-805ea54026fc not found, creating... [ 1394.930972] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.931282] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.931433] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.931678] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.931827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.937379] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.937379] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.937593] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.937694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.937784] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.937930] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2a975c24-54e7-40b2-a669-805ea54026fc is going to be created. [ 1394.974502] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.974746] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.974888] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.975232] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.975940] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.975940] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.040504] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3aa712c-b8eb-4aee-a74b-5ab4fb69f275 [ 1395.041482] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.041482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.041482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.041691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.041691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.041755] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3aa712c-b8eb-4aee-a74b-5ab4fb69f275 already deleted. [ 1395.041796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3aa712c-b8eb-4aee-a74b-5ab4fb69f275" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.243331] env[71051]: INFO networking_nsxv3.common.synchronization [req-44a52e13-7e17-4557-b9ea-7101bd9cc8b0 req-a90535bc-31df-452e-8311-4b9733cbbc30 tempest-ServerDiagnosticsTest-958780177 tempest-ServerDiagnosticsTest-958780177-project-member] Enqueued Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1395.243900] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1395.244251] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.244430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.244430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.244670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.244810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.245320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.245320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.245770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.246056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.246370] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.695303] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.695495] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.695611] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.696393] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.696393] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.696393] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.696538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.696715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.696883] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.697571] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1395.697749] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1395.697871] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1395.697986] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1395.698125] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1395.698235] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1395.698372] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1395.716658] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1395.716770] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1395.716997] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1395.717232] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.717569] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-dc19764e-902b-4170-8b32-f71f7a3c2bbb taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.717780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.717932] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.718346] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.718432] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc19764e-902b-4170-8b32-f71f7a3c2bbb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.753722] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.753722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.753722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.753998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.754211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.754351] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.754433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.754470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.754595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.754761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.754761] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c611102-ef9e-4425-9ced-e6be888b77ae already deleted. [ 1395.754847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.906227] env[71051]: INFO networking_nsxv3.common.synchronization [None req-33f18a83-6c9e-4f19-a546-e6ed36ca90f2 tempest-VolumesAssistedSnapshotsTest-2110512825 tempest-VolumesAssistedSnapshotsTest-2110512825-project-member] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1395.906227] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1395.906227] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.906359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.909021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.909021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.909021] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.084739] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4484fd94-be76-4050-9bda-bc0e19a985d9 None None] Enqueued Resource ID: 69274a50-7abf-4085-ad79-5d739dc8222d with Priority: HIGHEST for action port [ 1396.084739] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69274a50-7abf-4085-ad79-5d739dc8222d with Priority: HIGHEST for action port [ 1396.084739] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-69274a50-7abf-4085-ad79-5d739dc8222d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.084739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69274a50-7abf-4085-ad79-5d739dc8222d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.084739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69274a50-7abf-4085-ad79-5d739dc8222d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.084739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69274a50-7abf-4085-ad79-5d739dc8222d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.084739] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69274a50-7abf-4085-ad79-5d739dc8222d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.181461] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1005bc1e-080f-48d1-a859-42c6cd5c2563 tempest-VolumesAssistedSnapshotsTest-2110512825 tempest-VolumesAssistedSnapshotsTest-2110512825-project-member] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1396.181998] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1396.182313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.182411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.220876] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.221337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.221337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.221480] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.221814] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.221814] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port dc19764e-902b-4170-8b32-f71f7a3c2bbb not found, creating... [ 1396.222474] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.222474] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.222474] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.222771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.222771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.223244] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.223244] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.223373] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.223507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.223727] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.223789] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: dc19764e-902b-4170-8b32-f71f7a3c2bbb is going to be created. [ 1396.244714] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.244998] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.245061] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.245533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.245533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.246080] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.455069] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.455835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.455908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.456226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.457024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.457024] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 already deleted. [ 1396.457024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.457024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.457024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.457024] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [req-45afd458-ebc2-4c6d-b086-a6820007fb4d req-7e6a8c6e-0cdb-457a-b22e-a098aa93187e service nova] Enqueued Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_rules [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [req-45afd458-ebc2-4c6d-b086-a6820007fb4d req-7e6a8c6e-0cdb-457a-b22e-a098aa93187e service nova] Enqueued Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [req-45afd458-ebc2-4c6d-b086-a6820007fb4d req-7e6a8c6e-0cdb-457a-b22e-a098aa93187e service nova] Enqueued Resource ID: 2a975c24-54e7-40b2-a669-805ea54026fc with Priority: HIGHEST for action port [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_rules [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1396.493827] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a975c24-54e7-40b2-a669-805ea54026fc with Priority: HIGHEST for action port [ 1396.494223] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.494339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.494408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.494738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.494738] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.496441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.497312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.497312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.497312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.497312] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.497312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.497312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.497691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.497823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.497959] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.499237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a975c24-54e7-40b2-a669-805ea54026fc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.499237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.499377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.499581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.499705] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a975c24-54e7-40b2-a669-805ea54026fc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.588781] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69274a50-7abf-4085-ad79-5d739dc8222d [ 1396.589445] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.589673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.589673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.590540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.590785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.590962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69274a50-7abf-4085-ad79-5d739dc8222d already deleted. [ 1396.591120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69274a50-7abf-4085-ad79-5d739dc8222d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.985968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.985968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.985968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.985968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.985968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.985968] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 already deleted. [ 1396.985968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.003494] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.003494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.011117] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.013414] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a975c24-54e7-40b2-a669-805ea54026fc with status ACTIVE [ 1397.013414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.013414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.013414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.013414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.013414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.013414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.013798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.013798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.013798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.013798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.013962] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.014040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.014073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.014342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.014342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.014425] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a975c24-54e7-40b2-a669-805ea54026fc is going to be updated. [ 1397.031950] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8f8c47c1-1a08-4d76-a598-d66bbc06064f None None] Enqueued Resource ID: b10bdbe7-abc5-4a0f-b301-8b12755ebc64 with Priority: HIGHEST for action port [ 1397.033554] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10bdbe7-abc5-4a0f-b301-8b12755ebc64 with Priority: HIGHEST for action port [ 1397.034469] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b10bdbe7-abc5-4a0f-b301-8b12755ebc64 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.034469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b10bdbe7-abc5-4a0f-b301-8b12755ebc64" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.034660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b10bdbe7-abc5-4a0f-b301-8b12755ebc64" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.034864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b10bdbe7-abc5-4a0f-b301-8b12755ebc64" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.034952] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b10bdbe7-abc5-4a0f-b301-8b12755ebc64',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.039857] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.040090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.040380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.041012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.041213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.041392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a975c24-54e7-40b2-a669-805ea54026fc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.517358] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.540734] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b10bdbe7-abc5-4a0f-b301-8b12755ebc64 [ 1397.540734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.540734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.540734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.540734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.540734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.540734] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b10bdbe7-abc5-4a0f-b301-8b12755ebc64 already deleted. [ 1397.540734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b10bdbe7-abc5-4a0f-b301-8b12755ebc64" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.946488] env[71051]: INFO networking_nsxv3.common.synchronization [req-44a52e13-7e17-4557-b9ea-7101bd9cc8b0 req-68432ba4-960d-44b1-900d-ca807ec44ded service nova] Enqueued Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_rules [ 1397.946745] env[71051]: INFO networking_nsxv3.common.synchronization [req-44a52e13-7e17-4557-b9ea-7101bd9cc8b0 req-68432ba4-960d-44b1-900d-ca807ec44ded service nova] Enqueued Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1397.946965] env[71051]: INFO networking_nsxv3.common.synchronization [req-44a52e13-7e17-4557-b9ea-7101bd9cc8b0 req-68432ba4-960d-44b1-900d-ca807ec44ded service nova] Enqueued Resource ID: dc19764e-902b-4170-8b32-f71f7a3c2bbb with Priority: HIGHEST for action port [ 1397.947541] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_rules [ 1397.947666] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1397.947760] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc19764e-902b-4170-8b32-f71f7a3c2bbb with Priority: HIGHEST for action port [ 1397.948066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.948282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.948875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.948875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.948875] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.951441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.951441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.951441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.951441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.951441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.951676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.951676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.951739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.951794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.951891] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.953472] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc19764e-902b-4170-8b32-f71f7a3c2bbb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.953589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.956461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.956461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.956461] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc19764e-902b-4170-8b32-f71f7a3c2bbb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.008247] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c3785ffe-8b61-47a7-a062-e9c21d028f6d tempest-ServersWithSpecificFlavorTestJSON-2113755599 tempest-ServersWithSpecificFlavorTestJSON-2113755599-project-member] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1398.008247] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1398.008247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.008247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.008247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.008247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.008247] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.019691] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.020681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.020681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.020681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.020681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.020681] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 is going to be created. [ 1398.126346] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.126494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.127123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.127123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.127123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.161826] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: UNINITIALIZED for 2s [ 1398.250608] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2930d9a3-34d8-4f4d-8fbe-b78415e72f4c tempest-ServersWithSpecificFlavorTestJSON-2113755599 tempest-ServersWithSpecificFlavorTestJSON-2113755599-project-member] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1398.250608] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1398.252038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.252038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.457075] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.457370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.457370] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.458267] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc19764e-902b-4170-8b32-f71f7a3c2bbb with status ACTIVE [ 1398.458569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.458569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.458693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.458940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.458940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.459201] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.459276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.459309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.459564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.459564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.459709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.459768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.459930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.459974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.460632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.460876] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc19764e-902b-4170-8b32-f71f7a3c2bbb is going to be updated. [ 1398.483818] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.484015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.484125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.484422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.484526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.485188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc19764e-902b-4170-8b32-f71f7a3c2bbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.535944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.536262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.536262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.536388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.536501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.536658] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27aac1-26b8-4e44-9313-936316b62525 already deleted. [ 1398.536788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.536953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.537140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.537227] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.964212] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.056725] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.056882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.056946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.057181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.057276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.057371] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27aac1-26b8-4e44-9313-936316b62525 already deleted. [ 1399.057455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.467261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.467434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.467510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.467719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.467811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.467913] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c611102-ef9e-4425-9ced-e6be888b77ae is going to be created. [ 1399.492332] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.492509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.492611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.492839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.493012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.502471] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: UNINITIALIZED for 2s [ 1399.610884] env[71051]: INFO networking_nsxv3.common.synchronization [None req-76140636-f579-4b9f-95f3-9643b631fd9c None None] Enqueued Resource ID: f1408625-8d92-4c59-968f-2fa6e0949754 with Priority: HIGHEST for action port [ 1399.611825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1408625-8d92-4c59-968f-2fa6e0949754 with Priority: HIGHEST for action port [ 1399.611863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1408625-8d92-4c59-968f-2fa6e0949754 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.612580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1408625-8d92-4c59-968f-2fa6e0949754" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.612580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1408625-8d92-4c59-968f-2fa6e0949754" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.612580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1408625-8d92-4c59-968f-2fa6e0949754" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.612747] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1408625-8d92-4c59-968f-2fa6e0949754',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.115018] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1408625-8d92-4c59-968f-2fa6e0949754 [ 1400.115119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.115237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.115302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.115943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.115943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.115943] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1408625-8d92-4c59-968f-2fa6e0949754 already deleted. [ 1400.115943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1408625-8d92-4c59-968f-2fa6e0949754" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.173587] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: SUCCESS [ 1400.173866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.174484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.174484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.174484] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.174706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.174706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.174797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.177460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.177460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.177460] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.680054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.680348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.680348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.680543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.680715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.680835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.680900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.681154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.681957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.681957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.681957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.681957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.682362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.682362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.682421] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.682535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.682586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.682716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.682796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.683237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.683237] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.186898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b6fa828-b174-4bb7-a914-8abc9f68e473: rpc.has_security_group_logging(os_id): False [ 1401.206764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.206764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.206933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.207088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.207140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.207358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.207459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.207639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.208433] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.208433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.208639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.208639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.208639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.208760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.209961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.209961] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 is going to be created. [ 1401.231009] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8cf81d8-9dc3-48bf-8ffd-a651e1f486aa req-490a5102-f8c7-4171-b540-0b8480deaa78 tempest-ServersAdminNegativeTestJSON-889609971 tempest-ServersAdminNegativeTestJSON-889609971-project-member] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1401.232157] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1401.232157] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.232157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.232157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.232631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.232631] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.232631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.232844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.232844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.232950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.233028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.290015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.290015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.290015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.290015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.290015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.306958] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: IN_PROGRESS for 2s [ 1401.485852] env[71051]: INFO networking_nsxv3.common.synchronization [None req-52ffa9a6-01e5-43fb-b24b-a07a1f3e7726 None None] Enqueued Resource ID: 8d7b0338-ee09-49cb-bd06-47535e961f5d with Priority: HIGHEST for action port [ 1401.486239] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d7b0338-ee09-49cb-bd06-47535e961f5d with Priority: HIGHEST for action port [ 1401.486769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d7b0338-ee09-49cb-bd06-47535e961f5d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.486839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d7b0338-ee09-49cb-bd06-47535e961f5d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.486880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d7b0338-ee09-49cb-bd06-47535e961f5d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.488189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d7b0338-ee09-49cb-bd06-47535e961f5d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.488284] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d7b0338-ee09-49cb-bd06-47535e961f5d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.511988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: SUCCESS [ 1401.512299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.512438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.515250] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.515250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.515250] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.736989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.737438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.737438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.737438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.737583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.740616] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.740768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.740841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.741140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.741304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.741364] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 already deleted. [ 1401.741473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.992202] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d7b0338-ee09-49cb-bd06-47535e961f5d [ 1401.992202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.992202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.992202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.992202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.992202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.992202] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d7b0338-ee09-49cb-bd06-47535e961f5d already deleted. [ 1401.992202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d7b0338-ee09-49cb-bd06-47535e961f5d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.017558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.017753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.017974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.018075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.018247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.018500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.018500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.018760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.018760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.018848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.018981] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.019093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.019147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.019294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.019468] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.019572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.019623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.019819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.019969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.019969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.020097] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.523684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c611102-ef9e-4425-9ced-e6be888b77ae: rpc.has_security_group_logging(os_id): False [ 1402.545473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.545473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.545473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.545473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.546233] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.547695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.548146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.548396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.548559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.548746] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c611102-ef9e-4425-9ced-e6be888b77ae is going to be created. [ 1402.615261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.615261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.615261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.615261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.615698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.626587] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: IN_PROGRESS for 2s [ 1403.235139] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.235139] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.235139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.235139] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1403.235139] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1403.235139] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1403.235139] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1403.236019] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1403.236259] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1403.236514] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1403.265632] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1403.265632] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1403.265632] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1403.265632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.265632] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-e59a7fbc-2f9d-4200-8538-522d747ce0b7 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.265632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.265632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.265632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.265632] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59a7fbc-2f9d-4200-8538-522d747ce0b7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.315935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: SUCCESS [ 1403.316220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.603429] env[71051]: INFO networking_nsxv3.common.synchronization [req-a645fc2d-11e1-49b9-87fb-716b98a518c4 req-fa59f9e0-ce9c-40e6-83c4-9675f11dea03 tempest-ServersTestJSON-579992493 tempest-ServersTestJSON-579992493-project-member] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1403.603429] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1403.603429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.604738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.608063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.608063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.608063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.608206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.608206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.608837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.608837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.608837] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.768419] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.768907] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.769389] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.770688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.770688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.770688] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port e59a7fbc-2f9d-4200-8538-522d747ce0b7 not found, creating... [ 1403.770688] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.770688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.770688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.771109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.771109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.771831] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.774076] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.774720] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.775596] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.776443] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.776637] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: e59a7fbc-2f9d-4200-8538-522d747ce0b7 is going to be created. [ 1403.800349] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.800549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.800735] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.801085] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.801334] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.801565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.974985] env[71051]: INFO networking_nsxv3.common.synchronization [None req-0ff4156d-8a49-4378-82a7-8ebb06f7edf3 None None] Enqueued Resource ID: e6400111-0ad8-4d51-8586-c21e6a000d9c with Priority: HIGHEST for action port [ 1403.975548] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6400111-0ad8-4d51-8586-c21e6a000d9c with Priority: HIGHEST for action port [ 1403.975848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6400111-0ad8-4d51-8586-c21e6a000d9c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.975967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6400111-0ad8-4d51-8586-c21e6a000d9c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.980194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6400111-0ad8-4d51-8586-c21e6a000d9c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.980561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6400111-0ad8-4d51-8586-c21e6a000d9c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.980655] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6400111-0ad8-4d51-8586-c21e6a000d9c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.112355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.112649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.112649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.112792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.112887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.114943] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.115094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.115162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.115344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.115432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.115525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d already deleted. [ 1404.115607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.485186] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6400111-0ad8-4d51-8586-c21e6a000d9c [ 1404.485186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.485186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.485580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.485580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.485580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.485662] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6400111-0ad8-4d51-8586-c21e6a000d9c already deleted. [ 1404.485697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6400111-0ad8-4d51-8586-c21e6a000d9c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.633124] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-850 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.634023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-850" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.634023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-850" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.634023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-850" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.634240] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.634240] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.634422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.634670] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.638675] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.638675] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1404.638675] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1404.638675] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1404.638675] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1404.638675] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1404.638675] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1404.638675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1404.639666] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: SUCCESS [ 1404.639916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.653080] env[71051]: INFO networking_nsxv3.common.synchronization [None req-20f8fe05-1c3b-4b35-ab01-a4d8353ba15b None None] Enqueued Resource ID: e3bbbcbd-f706-4dcf-80a6-494586b44c06 with Priority: HIGHEST for action port [ 1404.655467] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bbbcbd-f706-4dcf-80a6-494586b44c06 with Priority: HIGHEST for action port [ 1404.655836] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3bbbcbd-f706-4dcf-80a6-494586b44c06 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.655966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3bbbcbd-f706-4dcf-80a6-494586b44c06" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.656120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3bbbcbd-f706-4dcf-80a6-494586b44c06" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.656438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3bbbcbd-f706-4dcf-80a6-494586b44c06" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.656501] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bbbcbd-f706-4dcf-80a6-494586b44c06',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.666166] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1404.666166] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1404.666166] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1404.666166] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-850" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.666528] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-621d1086-d39c-4e1f-8817-f109436c6323 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.666595] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.666729] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.667076] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.667224] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621d1086-d39c-4e1f-8817-f109436c6323',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.059455] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a70a1d3a-5e4c-4fd4-a2f7-f1abd868017f None None] Enqueued Resource ID: d11db338-3c4a-4e3c-b3c6-73d3847173d6 with Priority: HIGHEST for action port [ 1405.065068] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11db338-3c4a-4e3c-b3c6-73d3847173d6 with Priority: HIGHEST for action port [ 1405.065068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11db338-3c4a-4e3c-b3c6-73d3847173d6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.065068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11db338-3c4a-4e3c-b3c6-73d3847173d6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.065068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11db338-3c4a-4e3c-b3c6-73d3847173d6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.065068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11db338-3c4a-4e3c-b3c6-73d3847173d6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.065068] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11db338-3c4a-4e3c-b3c6-73d3847173d6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.160667] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3bbbcbd-f706-4dcf-80a6-494586b44c06 [ 1405.160667] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.160667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.160667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.160667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.160667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.160667] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3bbbcbd-f706-4dcf-80a6-494586b44c06 already deleted. [ 1405.160667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3bbbcbd-f706-4dcf-80a6-494586b44c06" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.169371] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.169717] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.169896] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.170235] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.170446] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.170701] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 621d1086-d39c-4e1f-8817-f109436c6323 not found, creating... [ 1405.170996] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.171654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.171654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.171654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.171872] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.172247] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.172483] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.172971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.172971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.173087] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.173257] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 621d1086-d39c-4e1f-8817-f109436c6323 is going to be created. [ 1405.193567] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.195020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.195020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.195020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.195020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.195020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.570435] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d11db338-3c4a-4e3c-b3c6-73d3847173d6 [ 1405.570879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.570879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.571022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.571316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.571316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.571417] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d11db338-3c4a-4e3c-b3c6-73d3847173d6 already deleted. [ 1405.571471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11db338-3c4a-4e3c-b3c6-73d3847173d6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.954754] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8d210e8-863c-470a-b1ce-6b113a24b91f req-ed2796c7-2433-4a9c-ac05-5a26ea19086c tempest-ServersTestManualDisk-284606207 tempest-ServersTestManualDisk-284606207-project-member] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1405.955966] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1405.955966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.955966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.955966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.957320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.957660] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.957844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.957957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.958386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.959532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.960143] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.292083] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e1492eef-18d6-45ff-b554-03974559a78b None None] Enqueued Resource ID: 761123f0-becd-4541-ab73-dbec0c1b87d3 with Priority: HIGHEST for action port [ 1406.294018] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761123f0-becd-4541-ab73-dbec0c1b87d3 with Priority: HIGHEST for action port [ 1406.294018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-761123f0-becd-4541-ab73-dbec0c1b87d3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.294018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761123f0-becd-4541-ab73-dbec0c1b87d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.294018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761123f0-becd-4541-ab73-dbec0c1b87d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.294018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761123f0-becd-4541-ab73-dbec0c1b87d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.294018] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761123f0-becd-4541-ab73-dbec0c1b87d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.302838] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8cf81d8-9dc3-48bf-8ffd-a651e1f486aa req-4139f9a8-f085-4254-9dbf-0aedfdaaa1cc service nova] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_rules [ 1406.302838] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8cf81d8-9dc3-48bf-8ffd-a651e1f486aa req-4139f9a8-f085-4254-9dbf-0aedfdaaa1cc service nova] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1406.302838] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8cf81d8-9dc3-48bf-8ffd-a651e1f486aa req-4139f9a8-f085-4254-9dbf-0aedfdaaa1cc service nova] Enqueued Resource ID: e59a7fbc-2f9d-4200-8538-522d747ce0b7 with Priority: HIGHEST for action port [ 1406.302838] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_rules [ 1406.302838] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1406.306041] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59a7fbc-2f9d-4200-8538-522d747ce0b7 with Priority: HIGHEST for action port [ 1406.306041] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.306041] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.306041] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.306041] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.306041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.306571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.306571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.306571] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.307522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e59a7fbc-2f9d-4200-8538-522d747ce0b7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.307522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.307522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.307800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.307849] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59a7fbc-2f9d-4200-8538-522d747ce0b7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.463184] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.463459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.463459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.463685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.463779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.463978] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.464098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.464162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.464319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.464398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.464485] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b already deleted. [ 1406.465636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.798683] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761123f0-becd-4541-ab73-dbec0c1b87d3 [ 1406.798683] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.798683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.798683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.798683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.798683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.798683] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761123f0-becd-4541-ab73-dbec0c1b87d3 already deleted. [ 1406.798683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761123f0-becd-4541-ab73-dbec0c1b87d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.809729] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.810658] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.810658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.813031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e59a7fbc-2f9d-4200-8538-522d747ce0b7 with status ACTIVE [ 1406.813267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.813355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.813393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.814691] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.814691] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.814691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.815151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.815151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.815151] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e59a7fbc-2f9d-4200-8538-522d747ce0b7 is going to be updated. [ 1406.835114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.836669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.836862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.837144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.837568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.838089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e59a7fbc-2f9d-4200-8538-522d747ce0b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.016685] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b2c0a031-3a0c-4538-9008-57a16c333e74 None None] Enqueued Resource ID: 756aeca1-f9bb-41af-85f8-f672836359ce with Priority: HIGHEST for action port [ 1407.017243] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 756aeca1-f9bb-41af-85f8-f672836359ce with Priority: HIGHEST for action port [ 1407.017539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-756aeca1-f9bb-41af-85f8-f672836359ce taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.017703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-756aeca1-f9bb-41af-85f8-f672836359ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.017738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-756aeca1-f9bb-41af-85f8-f672836359ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.017980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-756aeca1-f9bb-41af-85f8-f672836359ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.018890] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('756aeca1-f9bb-41af-85f8-f672836359ce',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.313585] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.523238] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 756aeca1-f9bb-41af-85f8-f672836359ce [ 1407.523238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.523238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.523238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.523444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.523479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.524992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:756aeca1-f9bb-41af-85f8-f672836359ce already deleted. [ 1407.524992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-756aeca1-f9bb-41af-85f8-f672836359ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.582794] env[71051]: INFO networking_nsxv3.common.synchronization [req-a645fc2d-11e1-49b9-87fb-716b98a518c4 req-136f57f1-add4-44f7-b8ea-78d6e24fda9a service nova] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1407.584090] env[71051]: INFO networking_nsxv3.common.synchronization [req-a645fc2d-11e1-49b9-87fb-716b98a518c4 req-136f57f1-add4-44f7-b8ea-78d6e24fda9a service nova] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1407.584090] env[71051]: INFO networking_nsxv3.common.synchronization [req-a645fc2d-11e1-49b9-87fb-716b98a518c4 req-136f57f1-add4-44f7-b8ea-78d6e24fda9a service nova] Enqueued Resource ID: 621d1086-d39c-4e1f-8817-f109436c6323 with Priority: HIGHEST for action port [ 1407.584090] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_rules [ 1407.584090] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1407.584574] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621d1086-d39c-4e1f-8817-f109436c6323 with Priority: HIGHEST for action port [ 1407.584574] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.584714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.585314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.585532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.585616] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.586580] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.586738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.586805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.587014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.587189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.587284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.587344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.587495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.587567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.587907] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.588690] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-621d1086-d39c-4e1f-8817-f109436c6323 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.588763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.588824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.589051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.589127] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621d1086-d39c-4e1f-8817-f109436c6323',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.778676] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.778873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-248" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.779032] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-248" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.779365] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-248" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.781157] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.784019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.784019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.784019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.784019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.784019] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.784019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1407.784019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1407.784019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1407.784019] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.784019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1407.784019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1407.808716] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1407.808716] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1407.808716] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1407.808716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-248" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.809305] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-51ef93dc-e923-4339-9810-406b694c5565 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.809305] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.809305] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.809509] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.811580] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ef93dc-e923-4339-9810-406b694c5565',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.818429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.818558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.818645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.820555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.820555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.820555] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be created. [ 1407.846522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.846665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.846729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.846929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.847114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.856712] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: UNINITIALIZED for 2s [ 1408.091051] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 621d1086-d39c-4e1f-8817-f109436c6323 with status ACTIVE [ 1408.091562] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.091562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.091562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.091726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.091813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.091991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.095944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.095944] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 621d1086-d39c-4e1f-8817-f109436c6323 is going to be updated. [ 1408.095944] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.095944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.095944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.122146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.122146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.122146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.122296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.123053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.123273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-621d1086-d39c-4e1f-8817-f109436c6323" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.195784] env[71051]: INFO networking_nsxv3.common.synchronization [req-e93d893a-ca63-4b1c-8bdd-a4bdc72fb77d req-e0a03a7d-df75-40e0-8284-779d2bac8e9c tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1408.195784] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1408.196205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.196205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.196205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.196423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.196455] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.199882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.199882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.199882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.199882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.199882] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.315663] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.315886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.319055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.319473] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.319664] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.319873] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 51ef93dc-e923-4339-9810-406b694c5565 not found, creating... [ 1408.320324] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.320620] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.320620] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.321288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.321288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.321410] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.321579] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.322406] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.322406] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.322406] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.322406] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 51ef93dc-e923-4339-9810-406b694c5565 is going to be created. [ 1408.345065] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.345065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.345065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.345065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.345065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.345065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.492638] env[71051]: INFO networking_nsxv3.common.synchronization [None req-592d8794-af07-4b0d-8655-9bbf132363f7 None None] Enqueued Resource ID: a7ad5438-2128-4694-9c85-166eacd9df0e with Priority: HIGHEST for action port [ 1408.493241] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ad5438-2128-4694-9c85-166eacd9df0e with Priority: HIGHEST for action port [ 1408.493566] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ad5438-2128-4694-9c85-166eacd9df0e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.493685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ad5438-2128-4694-9c85-166eacd9df0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.493807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ad5438-2128-4694-9c85-166eacd9df0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.495293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ad5438-2128-4694-9c85-166eacd9df0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.495437] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ad5438-2128-4694-9c85-166eacd9df0e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.596834] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.707119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.707119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.707119] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d already deleted. [ 1408.707119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.756966] env[71051]: INFO networking_nsxv3.common.synchronization [None req-38705061-8024-48f9-8e49-a38d87baa681 None None] Enqueued Resource ID: 97634df2-c037-4c1f-b534-5381d186913e with Priority: HIGHEST for action port [ 1408.756966] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97634df2-c037-4c1f-b534-5381d186913e with Priority: HIGHEST for action port [ 1408.756966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-97634df2-c037-4c1f-b534-5381d186913e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.756966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97634df2-c037-4c1f-b534-5381d186913e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.756966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97634df2-c037-4c1f-b534-5381d186913e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.756966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97634df2-c037-4c1f-b534-5381d186913e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.756966] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97634df2-c037-4c1f-b534-5381d186913e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.999079] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7ad5438-2128-4694-9c85-166eacd9df0e [ 1409.000815] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.000815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.000815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.001136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.001171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.001316] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7ad5438-2128-4694-9c85-166eacd9df0e already deleted. [ 1409.001544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ad5438-2128-4694-9c85-166eacd9df0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.103175] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.103175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.103175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.103175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.103175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.103175] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d is going to be created. [ 1409.125092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.125092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.125092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.125092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.125092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.149187] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: UNINITIALIZED for 2s [ 1409.261420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97634df2-c037-4c1f-b534-5381d186913e [ 1409.261420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.261420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.261420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.261420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.261420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.261420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97634df2-c037-4c1f-b534-5381d186913e already deleted. [ 1409.261751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97634df2-c037-4c1f-b534-5381d186913e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.662232] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.662389] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.662439] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.662851] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.663661] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.663876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.664121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.665132] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.665380] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.665676] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.665800] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1409.665918] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1409.666088] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1409.666254] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.666380] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1409.668110] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1409.707903] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1409.707903] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1409.707903] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1409.707903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.707903] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-c40e53be-96f3-444e-949f-ccf70045ddfb taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.707903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.707903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.707903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.707903] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40e53be-96f3-444e-949f-ccf70045ddfb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.869309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1409.869519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.871470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.871795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.871973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.872144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.872219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.872389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.872472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.872557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.872647] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.087149] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8d210e8-863c-470a-b1ce-6b113a24b91f req-d9409d31-349f-43df-bd7c-ff9b6542f97c service nova] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1410.087149] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8d210e8-863c-470a-b1ce-6b113a24b91f req-d9409d31-349f-43df-bd7c-ff9b6542f97c service nova] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1410.087149] env[71051]: INFO networking_nsxv3.common.synchronization [req-f8d210e8-863c-470a-b1ce-6b113a24b91f req-d9409d31-349f-43df-bd7c-ff9b6542f97c service nova] Enqueued Resource ID: 51ef93dc-e923-4339-9810-406b694c5565 with Priority: HIGHEST for action port [ 1410.087149] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_rules [ 1410.087149] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1410.088933] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51ef93dc-e923-4339-9810-406b694c5565 with Priority: HIGHEST for action port [ 1410.089376] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.089463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.089618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.089796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.089865] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.090875] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.090998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.090998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.091169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.091358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.091443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.091488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.091601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.091676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.091775] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.093214] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-51ef93dc-e923-4339-9810-406b694c5565 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.093321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.093382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.093539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.093621] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ef93dc-e923-4339-9810-406b694c5565',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.212614] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.212936] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.213538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.213538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.213538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.213736] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port c40e53be-96f3-444e-949f-ccf70045ddfb not found, creating... [ 1410.213853] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.214027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.214820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.214820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.214820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.215183] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.215357] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.215665] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.215773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.215834] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.215962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: c40e53be-96f3-444e-949f-ccf70045ddfb is going to be created. [ 1410.239638] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.239638] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.240244] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.240244] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.240665] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.240760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.375694] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.375877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.375942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.376764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.376960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.377096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.377159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.377390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.377486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.377578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.377731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.377823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.377895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.378873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.379235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.379363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.379431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.380249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.381055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.381055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.381055] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.595178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.595349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.595799] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51ef93dc-e923-4339-9810-406b694c5565 with status ACTIVE [ 1410.596017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.596282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.596521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.596662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.596771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.596969] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.597671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.597671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.597671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.597671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.597671] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.597671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.597908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.598031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.598153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.598260] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51ef93dc-e923-4339-9810-406b694c5565 is going to be updated. [ 1410.600174] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.622801] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.623031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.623031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.623258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.623392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.623554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51ef93dc-e923-4339-9810-406b694c5565" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.746910] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e808007f-ed9c-410e-b15c-32824c5d14e3 None None] Enqueued Resource ID: ffa19380-fe2a-4a6a-ba85-ae48c39f33ad with Priority: HIGHEST for action port [ 1410.747207] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa19380-fe2a-4a6a-ba85-ae48c39f33ad with Priority: HIGHEST for action port [ 1410.748166] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffa19380-fe2a-4a6a-ba85-ae48c39f33ad taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.748299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffa19380-fe2a-4a6a-ba85-ae48c39f33ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.748359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffa19380-fe2a-4a6a-ba85-ae48c39f33ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.748714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffa19380-fe2a-4a6a-ba85-ae48c39f33ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.748835] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa19380-fe2a-4a6a-ba85-ae48c39f33ad',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.884989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61b3ef5c-fe30-4fa8-843f-b800b5921066: rpc.has_security_group_logging(os_id): False [ 1410.904155] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.904896] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.904896] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.906968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.906968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.906968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.906968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.907504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.907504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.907504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.907504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.907504] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be created. [ 1410.913232] env[71051]: INFO networking_nsxv3.common.synchronization [None req-20a15d50-5735-4f95-8de5-ab788fb1c705 None None] Enqueued Resource ID: 5ee52ab0-a83f-4e74-957d-834874ba5c14 with Priority: HIGHEST for action port [ 1410.913769] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee52ab0-a83f-4e74-957d-834874ba5c14 with Priority: HIGHEST for action port [ 1410.914345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ee52ab0-a83f-4e74-957d-834874ba5c14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.914673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ee52ab0-a83f-4e74-957d-834874ba5c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.914783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ee52ab0-a83f-4e74-957d-834874ba5c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.915060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ee52ab0-a83f-4e74-957d-834874ba5c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.915212] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee52ab0-a83f-4e74-957d-834874ba5c14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.006874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.007029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.007112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.007390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.007706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.022649] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1411.038491] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fd016e9-deb0-4330-a125-4b74f01fda4c req-4b1b3163-20cf-42b8-b28e-435f9aa3fe71 tempest-ServerExternalEventsTest-79770044 tempest-ServerExternalEventsTest-79770044-project-member] Enqueued Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1411.040274] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1411.040274] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.040274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.040427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.040550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.040712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.040811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.040877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.041462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.041462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.041462] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.105383] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.163043] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: SUCCESS [ 1411.163471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.163597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.163828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.164050] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.164183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.164247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.164403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.164485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.164600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.164660] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.250989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffa19380-fe2a-4a6a-ba85-ae48c39f33ad [ 1411.251333] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.251513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.251613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.251926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.252021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.252107] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffa19380-fe2a-4a6a-ba85-ae48c39f33ad already deleted. [ 1411.252422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffa19380-fe2a-4a6a-ba85-ae48c39f33ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.420438] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ee52ab0-a83f-4e74-957d-834874ba5c14 [ 1411.420674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.420826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.420890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.421212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.421308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.421429] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ee52ab0-a83f-4e74-957d-834874ba5c14 already deleted. [ 1411.421494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ee52ab0-a83f-4e74-957d-834874ba5c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.494754] env[71051]: INFO networking_nsxv3.common.synchronization [req-e93d893a-ca63-4b1c-8bdd-a4bdc72fb77d req-3259f580-cb5a-4821-815a-a191e829505b service nova] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1411.494754] env[71051]: INFO networking_nsxv3.common.synchronization [req-e93d893a-ca63-4b1c-8bdd-a4bdc72fb77d req-3259f580-cb5a-4821-815a-a191e829505b service nova] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1411.494754] env[71051]: INFO networking_nsxv3.common.synchronization [req-e93d893a-ca63-4b1c-8bdd-a4bdc72fb77d req-3259f580-cb5a-4821-815a-a191e829505b service nova] Enqueued Resource ID: c40e53be-96f3-444e-949f-ccf70045ddfb with Priority: HIGHEST for action port [ 1411.494937] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_rules [ 1411.494937] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1411.495056] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40e53be-96f3-444e-949f-ccf70045ddfb with Priority: HIGHEST for action port [ 1411.495308] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.495422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.495484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.495679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.495756] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.496748] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.496856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.496921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.497127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.497271] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.497363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.497418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.497561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.497812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.498046] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.498686] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c40e53be-96f3-444e-949f-ccf70045ddfb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.498783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.498848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.499025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.499110] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40e53be-96f3-444e-949f-ccf70045ddfb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.544652] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.544652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.544652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.544853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.544853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.545036] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.545135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.545231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.545401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.547916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.547916] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a48a7216-9768-452e-a3d9-cf477a05890c already deleted. [ 1411.547916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.576698] env[71051]: INFO networking_nsxv3.common.synchronization [None req-d70b2754-b7e3-40b2-ab22-22fcfed1dfd0 None None] Enqueued Resource ID: a4563ba1-c149-4c73-af9b-3c42c426acb1 with Priority: HIGHEST for action port [ 1411.576803] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4563ba1-c149-4c73-af9b-3c42c426acb1 with Priority: HIGHEST for action port [ 1411.577394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4563ba1-c149-4c73-af9b-3c42c426acb1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.577504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4563ba1-c149-4c73-af9b-3c42c426acb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.577570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4563ba1-c149-4c73-af9b-3c42c426acb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.577815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4563ba1-c149-4c73-af9b-3c42c426acb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.578657] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4563ba1-c149-4c73-af9b-3c42c426acb1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.606394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.606597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.606597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.606795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.606944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.606999] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b is going to be created. [ 1411.633895] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.634056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.634131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.634364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.634520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.671520] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.682352] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.682352] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.682352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.682352] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1411.682352] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1411.682352] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1411.682352] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1411.682798] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1411.682798] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1411.682798] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1411.723503] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: UNINITIALIZED for 2s [ 1411.746228] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1411.746228] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1411.746228] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1411.746228] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.746560] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-7e1701bf-4447-4202-9f29-adee6286eb74 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.746740] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.746860] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.750874] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.751247] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e1701bf-4447-4202-9f29-adee6286eb74',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.948946] env[71051]: INFO networking_nsxv3.common.synchronization [None req-85442e3b-50e9-4783-9ed5-8aed44692c77 None None] Enqueued Resource ID: a85f9157-286c-42d5-ae3f-2b4b1bcf7230 with Priority: HIGHEST for action port [ 1411.948946] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a85f9157-286c-42d5-ae3f-2b4b1bcf7230 with Priority: HIGHEST for action port [ 1411.949788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a85f9157-286c-42d5-ae3f-2b4b1bcf7230 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.949873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a85f9157-286c-42d5-ae3f-2b4b1bcf7230" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.949932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a85f9157-286c-42d5-ae3f-2b4b1bcf7230" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.950217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a85f9157-286c-42d5-ae3f-2b4b1bcf7230" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.950296] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a85f9157-286c-42d5-ae3f-2b4b1bcf7230',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.001934] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.002965] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.003096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.003265] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c40e53be-96f3-444e-949f-ccf70045ddfb with status ACTIVE [ 1412.003434] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.003552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.003799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.003799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.003892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.004079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.004625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.004625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.004625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.004625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.004625] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.004920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.004920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.004920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.005028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.005325] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c40e53be-96f3-444e-949f-ccf70045ddfb is going to be updated. [ 1412.027987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.028193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.028264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.028499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.028634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.028807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c40e53be-96f3-444e-949f-ccf70045ddfb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.082992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4563ba1-c149-4c73-af9b-3c42c426acb1 [ 1412.083353] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.083555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.083685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.083949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.084106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.084913] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4563ba1-c149-4c73-af9b-3c42c426acb1 already deleted. [ 1412.085769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4563ba1-c149-4c73-af9b-3c42c426acb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.175462] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c6810b9-50d2-45a8-bd88-0a9b6019a88d: rpc.has_security_group_logging(os_id): False [ 1412.194199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.194404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.194483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.194731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.195684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.195985] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.196192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.196296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.196500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.196704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.196704] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d is going to be created. [ 1412.254075] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.254315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.254440] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.254750] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.254962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.255072] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 7e1701bf-4447-4202-9f29-adee6286eb74 not found, creating... [ 1412.255345] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.255499] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.255611] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.256063] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.256063] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.256271] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.256430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.256553] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.256759] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.256894] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.259321] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 7e1701bf-4447-4202-9f29-adee6286eb74 is going to be created. [ 1412.279647] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.279799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.279870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.282058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.282058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.285031] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.285031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.285216] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.285994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.285994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.285994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.301271] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: IN_PROGRESS for 2s [ 1412.455550] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a85f9157-286c-42d5-ae3f-2b4b1bcf7230 [ 1412.456233] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.456233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.456233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.456644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.456644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.461258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a85f9157-286c-42d5-ae3f-2b4b1bcf7230 already deleted. [ 1412.461258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a85f9157-286c-42d5-ae3f-2b4b1bcf7230" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.510429] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.729080] env[71051]: INFO networking_nsxv3.common.synchronization [None req-59b727d4-1e49-4708-be64-d4efd1abd93a None None] Enqueued Resource ID: 8698e3d6-dd41-4738-83d4-283e621d8aa3 with Priority: HIGHEST for action port [ 1412.729080] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8698e3d6-dd41-4738-83d4-283e621d8aa3 with Priority: HIGHEST for action port [ 1412.729080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8698e3d6-dd41-4738-83d4-283e621d8aa3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.729080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8698e3d6-dd41-4738-83d4-283e621d8aa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.729080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8698e3d6-dd41-4738-83d4-283e621d8aa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.729080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8698e3d6-dd41-4738-83d4-283e621d8aa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.729080] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8698e3d6-dd41-4738-83d4-283e621d8aa3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.806615] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c4666984-077f-4b0c-a85e-10c03d138629 None None] Enqueued Resource ID: 70880439-10cb-4003-ae33-746a2f3d5c17 with Priority: HIGHEST for action port [ 1412.807161] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70880439-10cb-4003-ae33-746a2f3d5c17 with Priority: HIGHEST for action port [ 1412.807472] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-70880439-10cb-4003-ae33-746a2f3d5c17 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.807818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70880439-10cb-4003-ae33-746a2f3d5c17" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.807818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70880439-10cb-4003-ae33-746a2f3d5c17" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.808975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70880439-10cb-4003-ae33-746a2f3d5c17" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.808975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70880439-10cb-4003-ae33-746a2f3d5c17',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.016088] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.016284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.016351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.016615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.016712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.016819] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d is going to be created. [ 1413.040107] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1413.040355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.045922] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.046174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.046280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.046508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.046706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.056309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: UNINITIALIZED for 2s [ 1413.234827] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8698e3d6-dd41-4738-83d4-283e621d8aa3 [ 1413.235370] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.235370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.235370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.235370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.235539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.235569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8698e3d6-dd41-4738-83d4-283e621d8aa3 already deleted. [ 1413.236357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8698e3d6-dd41-4738-83d4-283e621d8aa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.312338] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70880439-10cb-4003-ae33-746a2f3d5c17 [ 1413.312338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.312338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.312338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.312338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.312338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.312338] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70880439-10cb-4003-ae33-746a2f3d5c17 already deleted. [ 1413.312338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70880439-10cb-4003-ae33-746a2f3d5c17" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.335950] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fd016e9-deb0-4330-a125-4b74f01fda4c req-84046b81-1fa5-46e7-8c03-f6aa1eb93897 service nova] Enqueued Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_rules [ 1413.336188] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fd016e9-deb0-4330-a125-4b74f01fda4c req-84046b81-1fa5-46e7-8c03-f6aa1eb93897 service nova] Enqueued Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1413.336329] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fd016e9-deb0-4330-a125-4b74f01fda4c req-84046b81-1fa5-46e7-8c03-f6aa1eb93897 service nova] Enqueued Resource ID: 7e1701bf-4447-4202-9f29-adee6286eb74 with Priority: HIGHEST for action port [ 1413.336624] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_rules [ 1413.337057] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1413.337057] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e1701bf-4447-4202-9f29-adee6286eb74 with Priority: HIGHEST for action port [ 1413.337406] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.337540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.337607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.338934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.338934] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.342030] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.342244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.342279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.342465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.344202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.344202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.344202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.344202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.344202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.344202] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.347531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e1701bf-4447-4202-9f29-adee6286eb74 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.347644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.347644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.349470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.349470] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e1701bf-4447-4202-9f29-adee6286eb74',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.738474] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: SUCCESS [ 1413.738639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.738814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.739181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.739297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.739412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.739933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.739933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.739933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.739933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.739933] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.850345] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.852859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.852859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.852859] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e1701bf-4447-4202-9f29-adee6286eb74 with status ACTIVE [ 1413.852859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.852859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.852859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.852859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.852859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.853265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.853308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.853500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.853612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.853704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.853890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.853980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.854060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.854278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.854278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.854360] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e1701bf-4447-4202-9f29-adee6286eb74 is going to be updated. [ 1413.880126] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.880261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.880425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.880530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.880660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.880846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e1701bf-4447-4202-9f29-adee6286eb74" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.938217] env[71051]: INFO networking_nsxv3.common.synchronization [None req-77b1eaed-1971-4c88-acbe-7531b16357fb None None] Enqueued Resource ID: 90134e05-7842-41aa-82a0-9ab3dc89a235 with Priority: HIGHEST for action port [ 1413.938613] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90134e05-7842-41aa-82a0-9ab3dc89a235 with Priority: HIGHEST for action port [ 1413.939130] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-90134e05-7842-41aa-82a0-9ab3dc89a235 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.939254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90134e05-7842-41aa-82a0-9ab3dc89a235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.939317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90134e05-7842-41aa-82a0-9ab3dc89a235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.939574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90134e05-7842-41aa-82a0-9ab3dc89a235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.939653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90134e05-7842-41aa-82a0-9ab3dc89a235',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.015186] env[71051]: INFO networking_nsxv3.common.synchronization [None req-aa555eae-0098-448e-ba12-1ce68434b5c2 None None] Enqueued Resource ID: 6a4b527d-a4f4-446e-a5a7-50ffbec6ab62 with Priority: HIGHEST for action port [ 1414.015454] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4b527d-a4f4-446e-a5a7-50ffbec6ab62 with Priority: HIGHEST for action port [ 1414.016104] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4b527d-a4f4-446e-a5a7-50ffbec6ab62 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.016310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4b527d-a4f4-446e-a5a7-50ffbec6ab62" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.016388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4b527d-a4f4-446e-a5a7-50ffbec6ab62" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.016738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4b527d-a4f4-446e-a5a7-50ffbec6ab62" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.016856] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4b527d-a4f4-446e-a5a7-50ffbec6ab62',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.246821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.314353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: SUCCESS [ 1414.314411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.352863] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.442227] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90134e05-7842-41aa-82a0-9ab3dc89a235 [ 1414.442791] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.442791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.442791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.443073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.443073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.443073] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90134e05-7842-41aa-82a0-9ab3dc89a235 already deleted. [ 1414.443181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90134e05-7842-41aa-82a0-9ab3dc89a235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.518549] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a4b527d-a4f4-446e-a5a7-50ffbec6ab62 [ 1414.518813] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.518971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.519057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.519300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.519394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.519491] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a4b527d-a4f4-446e-a5a7-50ffbec6ab62 already deleted. [ 1414.519573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4b527d-a4f4-446e-a5a7-50ffbec6ab62" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.750702] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6235e93c-519f-43a7-8c8b-5c8b7d56575b: rpc.has_security_group_logging(os_id): False [ 1414.773235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.773395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.776098] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.776098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.776098] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b is going to be created. [ 1414.841950] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.843955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.843955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.843955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.843955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.854914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: IN_PROGRESS for 2s [ 1414.857589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.857733] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.857813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.858239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.858239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.858239] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a48a7216-9768-452e-a3d9-cf477a05890c is going to be created. [ 1414.894063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.894063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.894063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.894063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.894063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.910234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: UNINITIALIZED for 2s [ 1415.072750] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: SUCCESS [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.072750] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.072750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.072750] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.576243] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.078106] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8620a6a-16cb-4fc6-af53-e0b0622d304d: rpc.has_security_group_logging(os_id): False [ 1416.098881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.098881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.098881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.099853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.099853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.099853] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.099853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.101466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.101466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.101466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.101466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d is going to be created. [ 1416.165290] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.165290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.165290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.165290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.165290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.174541] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: IN_PROGRESS for 2s [ 1416.867723] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: SUCCESS [ 1416.868685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.920289] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: SUCCESS [ 1416.920525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.920698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.920914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.921158] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.921272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.921332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.921516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.921598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.921686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.921779] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.980522] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a4683baf-9ba2-4123-b584-66511bc01ef4 tempest-ServersV294TestFqdnHostnames-1299815983 tempest-ServersV294TestFqdnHostnames-1299815983-project-member] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1416.981191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1416.981503] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.981619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.981686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.981930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.982030] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.101803] env[71051]: INFO networking_nsxv3.common.synchronization [None req-7df70ff0-cbb5-4b37-8869-b5991e624e76 None None] Enqueued Resource ID: c363e029-5f28-485c-92b2-4c0fc045add9 with Priority: HIGHEST for action port [ 1417.102496] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c363e029-5f28-485c-92b2-4c0fc045add9 with Priority: HIGHEST for action port [ 1417.102825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c363e029-5f28-485c-92b2-4c0fc045add9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.102950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c363e029-5f28-485c-92b2-4c0fc045add9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.103787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c363e029-5f28-485c-92b2-4c0fc045add9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.103787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c363e029-5f28-485c-92b2-4c0fc045add9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.104094] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c363e029-5f28-485c-92b2-4c0fc045add9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.139693] env[71051]: INFO networking_nsxv3.common.synchronization [None req-afc31a2e-9e67-46c4-b952-4af273fc4135 tempest-ServersV294TestFqdnHostnames-1299815983 tempest-ServersV294TestFqdnHostnames-1299815983-project-member] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1417.140646] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1417.141088] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.141943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.427531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.427724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.427803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.428258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.428258] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.428369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.428405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.428580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.428652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.428709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.428860] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.428964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.429054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.429388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.429388] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.429534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.429534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.429632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.429691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.429808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.429896] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.506749] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.507018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.507070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.507353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.507464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.507571] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 already deleted. [ 1417.507661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.507917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.508014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.508079] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.608065] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c363e029-5f28-485c-92b2-4c0fc045add9 [ 1417.608065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.608065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.608065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.608065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.608065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.608065] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c363e029-5f28-485c-92b2-4c0fc045add9 already deleted. [ 1417.608065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c363e029-5f28-485c-92b2-4c0fc045add9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.932940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a48a7216-9768-452e-a3d9-cf477a05890c: rpc.has_security_group_logging(os_id): False [ 1417.959475] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.959625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.959666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.959863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.959959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.960588] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.960588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.960588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.960588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.960588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.960797] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.960840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.960901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.961109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.961216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.961677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.961887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.961990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.962277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.964250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.964250] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a48a7216-9768-452e-a3d9-cf477a05890c is going to be created. [ 1418.028179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.029052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.029052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.029052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.029052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.035473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.035725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.035837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.036106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.036324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.036410] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 already deleted. [ 1418.036620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.039700] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: IN_PROGRESS for 2s [ 1418.188418] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: SUCCESS [ 1418.188687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.509061] env[71051]: INFO networking_nsxv3.common.synchronization [None req-26c00b0d-7401-4cbf-88f3-f981f4e7052a None None] Enqueued Resource ID: 1b780247-8661-4062-b606-4049ec1890f9 with Priority: HIGHEST for action port [ 1418.509407] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b780247-8661-4062-b606-4049ec1890f9 with Priority: HIGHEST for action port [ 1418.509986] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b780247-8661-4062-b606-4049ec1890f9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.510243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b780247-8661-4062-b606-4049ec1890f9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.510243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b780247-8661-4062-b606-4049ec1890f9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.510478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b780247-8661-4062-b606-4049ec1890f9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.510604] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b780247-8661-4062-b606-4049ec1890f9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.012985] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b780247-8661-4062-b606-4049ec1890f9 [ 1419.014145] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.014145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.014145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.014145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.014145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.014395] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b780247-8661-4062-b606-4049ec1890f9 already deleted. [ 1419.014395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b780247-8661-4062-b606-4049ec1890f9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.572022] env[71051]: INFO networking_nsxv3.common.synchronization [req-d56dc04c-7fd0-467c-b37b-cf770e4c3b73 req-fa8863c6-1295-4952-840b-626676968c3e tempest-VolumesAssistedSnapshotsTest-2110512825 tempest-VolumesAssistedSnapshotsTest-2110512825-project-member] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1419.572937] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1419.573437] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.574734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.574734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.574734] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.057460] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: SUCCESS [ 1420.057792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.077322] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.077483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.077547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.077761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.077852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.078223] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.078223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.078223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.078457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.078457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.078589] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 already deleted. [ 1420.078589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.417378] env[71051]: INFO networking_nsxv3.common.synchronization [None req-434d0bcb-03c0-41f4-984c-e9dc8b0c61a7 None None] Enqueued Resource ID: 4314be9c-8c5a-4af5-8535-a662ffa4943c with Priority: HIGHEST for action port [ 1420.417882] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4314be9c-8c5a-4af5-8535-a662ffa4943c with Priority: HIGHEST for action port [ 1420.418477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4314be9c-8c5a-4af5-8535-a662ffa4943c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.418704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4314be9c-8c5a-4af5-8535-a662ffa4943c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.418704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4314be9c-8c5a-4af5-8535-a662ffa4943c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.419074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4314be9c-8c5a-4af5-8535-a662ffa4943c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.419283] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4314be9c-8c5a-4af5-8535-a662ffa4943c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.923115] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4314be9c-8c5a-4af5-8535-a662ffa4943c [ 1420.923115] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.923115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.923115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.923115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.923427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.923427] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4314be9c-8c5a-4af5-8535-a662ffa4943c already deleted. [ 1420.923427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4314be9c-8c5a-4af5-8535-a662ffa4943c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.931628] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.932622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-887" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.932622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-887" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.932622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-887" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.932766] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.934066] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.934066] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.934066] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.934066] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.934066] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1420.934066] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1420.934398] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1420.934559] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1420.934746] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1420.934904] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1420.935237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1420.967511] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1420.967678] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1420.968498] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1420.968498] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-887" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.968498] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-7f092f6e-b465-43b4-a9ef-09682095061b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.968498] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.968886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.969077] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.969157] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f092f6e-b465-43b4-a9ef-09682095061b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.239753] env[71051]: INFO networking_nsxv3.common.synchronization [None req-deecd92e-395f-4cba-8c11-2a63d809af54 None None] Enqueued Resource ID: 059bdd6a-4654-4084-ae5f-985ca0a1f45a with Priority: HIGHEST for action port [ 1421.240052] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059bdd6a-4654-4084-ae5f-985ca0a1f45a with Priority: HIGHEST for action port [ 1421.240640] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-059bdd6a-4654-4084-ae5f-985ca0a1f45a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.240640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-059bdd6a-4654-4084-ae5f-985ca0a1f45a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.240817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-059bdd6a-4654-4084-ae5f-985ca0a1f45a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.240983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-059bdd6a-4654-4084-ae5f-985ca0a1f45a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.243239] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('059bdd6a-4654-4084-ae5f-985ca0a1f45a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.473237] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.473237] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.473237] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.473237] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.473471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.474118] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 7f092f6e-b465-43b4-a9ef-09682095061b not found, creating... [ 1421.474118] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.474118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.474118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.474346] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.474432] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.474986] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.475537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.475537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.475662] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.475866] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.476106] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 7f092f6e-b465-43b4-a9ef-09682095061b is going to be created. [ 1421.496060] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.496237] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.496374] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.497013] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.497265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.497484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.748689] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 059bdd6a-4654-4084-ae5f-985ca0a1f45a [ 1421.750433] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.750433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.750433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.750433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.750433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.750433] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:059bdd6a-4654-4084-ae5f-985ca0a1f45a already deleted. [ 1421.750433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-059bdd6a-4654-4084-ae5f-985ca0a1f45a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.290639] env[71051]: INFO networking_nsxv3.common.synchronization [req-45a29556-57c1-4c10-81fb-0600ae991e52 req-487dac37-910b-4b08-a5a3-c8be6ce61814 tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1422.291237] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1422.291608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.291802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.291802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.292439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.292591] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.292660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.292696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.292856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.292936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.293047] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.432720] env[71051]: INFO networking_nsxv3.common.synchronization [None req-218517a2-8225-42c0-a869-f33ae4664cd3 None None] Enqueued Resource ID: b67c7eac-c554-4552-a95d-b19ec798a2aa with Priority: HIGHEST for action port [ 1422.433197] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b67c7eac-c554-4552-a95d-b19ec798a2aa with Priority: HIGHEST for action port [ 1422.433960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b67c7eac-c554-4552-a95d-b19ec798a2aa taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.434086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b67c7eac-c554-4552-a95d-b19ec798a2aa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.434143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b67c7eac-c554-4552-a95d-b19ec798a2aa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.434381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b67c7eac-c554-4552-a95d-b19ec798a2aa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.434468] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b67c7eac-c554-4552-a95d-b19ec798a2aa',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.796420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.796420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.796420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.796420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.796420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.796420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.796420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.796811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.796811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.796917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.797040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b already deleted. [ 1422.797152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.881146] env[71051]: INFO networking_nsxv3.common.synchronization [req-9acc6e7a-598f-4cdc-b7fe-ad802dadc095 req-d5d01431-5724-48e5-b123-1b6650b12264 tempest-ServerDiagnosticsTest-958780177 tempest-ServerDiagnosticsTest-958780177-project-member] Enqueued Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1422.881727] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c611102-ef9e-4425-9ced-e6be888b77ae with Priority: HIGHEST for action security_group_members [ 1422.882080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c611102-ef9e-4425-9ced-e6be888b77ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.882220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.882290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.882488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.882654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.882751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.882828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.882955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.883055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.883154] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c611102-ef9e-4425-9ced-e6be888b77ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.938305] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b67c7eac-c554-4552-a95d-b19ec798a2aa [ 1422.938544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.938682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.938754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.939420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.939420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.939420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b67c7eac-c554-4552-a95d-b19ec798a2aa already deleted. [ 1422.939420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b67c7eac-c554-4552-a95d-b19ec798a2aa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.306547] env[71051]: INFO networking_nsxv3.common.synchronization [req-d56dc04c-7fd0-467c-b37b-cf770e4c3b73 req-34e29793-1674-43f1-a526-8a00f7eabcc3 service nova] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1423.306839] env[71051]: INFO networking_nsxv3.common.synchronization [req-d56dc04c-7fd0-467c-b37b-cf770e4c3b73 req-34e29793-1674-43f1-a526-8a00f7eabcc3 service nova] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1423.307293] env[71051]: INFO networking_nsxv3.common.synchronization [req-d56dc04c-7fd0-467c-b37b-cf770e4c3b73 req-34e29793-1674-43f1-a526-8a00f7eabcc3 service nova] Enqueued Resource ID: 7f092f6e-b465-43b4-a9ef-09682095061b with Priority: HIGHEST for action port [ 1423.307398] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_rules [ 1423.307593] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1423.307657] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f092f6e-b465-43b4-a9ef-09682095061b with Priority: HIGHEST for action port [ 1423.308234] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.308234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.308234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.308817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.308817] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.309639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.309820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.309820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.310088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.310274] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.310464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.310464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.310684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.310684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.310787] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.312189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f092f6e-b465-43b4-a9ef-09682095061b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.312327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.312406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.312588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.313967] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f092f6e-b465-43b4-a9ef-09682095061b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.353057] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.353682] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.353682] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.353781] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.354427] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.354427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.354555] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.354827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.355886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.356230] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1423.356412] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1423.356546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1423.356663] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1423.356795] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1423.356905] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1423.357068] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1423.381557] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1423.381745] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1423.381887] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1423.382126] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.382531] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2622e3e3-af96-41ab-9040-33c622c4a025 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.382711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.382929] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.383168] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.383312] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2622e3e3-af96-41ab-9040-33c622c4a025',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.386183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.386183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.386183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.386802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.386802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.386802] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c611102-ef9e-4425-9ced-e6be888b77ae is going to be updated. [ 1423.444590] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.444590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.444590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.444590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.444590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.451697] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: IN_PROGRESS for 2s [ 1423.815993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.815993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.815993] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.816764] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f092f6e-b465-43b4-a9ef-09682095061b with status ACTIVE [ 1423.816925] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.817026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.817848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.817848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.818208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.819228] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.819345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.819416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.819561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.819645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.819751] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f092f6e-b465-43b4-a9ef-09682095061b is going to be updated. [ 1423.842176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.842526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.842785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.844141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.844348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.844411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f092f6e-b465-43b4-a9ef-09682095061b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.885327] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.885547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.885827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.885965] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.887036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.887036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2622e3e3-af96-41ab-9040-33c622c4a025 not found, creating... [ 1423.887036] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.887036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.887036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.887291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.887291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.887528] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.887686] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.887803] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.888059] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.888200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.888392] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2622e3e3-af96-41ab-9040-33c622c4a025 is going to be created. [ 1423.910253] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.910457] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.910607] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.910875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.911447] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.911447] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.322340] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.543054] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fe7ed78e-3a0d-4c3a-a600-2af80ab25233 None None] Enqueued Resource ID: 1926e593-dc88-4ca8-93b4-cb9f6bc8f86e with Priority: HIGHEST for action port [ 1424.543906] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1926e593-dc88-4ca8-93b4-cb9f6bc8f86e with Priority: HIGHEST for action port [ 1424.544305] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1926e593-dc88-4ca8-93b4-cb9f6bc8f86e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.544489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1926e593-dc88-4ca8-93b4-cb9f6bc8f86e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.544642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1926e593-dc88-4ca8-93b4-cb9f6bc8f86e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.544918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1926e593-dc88-4ca8-93b4-cb9f6bc8f86e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.545019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1926e593-dc88-4ca8-93b4-cb9f6bc8f86e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.644293] env[71051]: INFO networking_nsxv3.common.synchronization [None req-7415a4ca-b98c-4182-be3a-56dccee1cec0 None None] Enqueued Resource ID: 7ea62961-e317-4c2f-b4d9-668056373014 with Priority: HIGHEST for action port [ 1424.644293] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea62961-e317-4c2f-b4d9-668056373014 with Priority: HIGHEST for action port [ 1424.644655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea62961-e317-4c2f-b4d9-668056373014 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.644805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea62961-e317-4c2f-b4d9-668056373014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.645037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea62961-e317-4c2f-b4d9-668056373014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.645276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea62961-e317-4c2f-b4d9-668056373014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.645507] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea62961-e317-4c2f-b4d9-668056373014',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.825501] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.826227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.826270] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.826482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.826581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.827637] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 is going to be created. [ 1424.853616] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.853783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.853834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.854043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.854203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.864950] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: UNINITIALIZED for 2s [ 1425.047810] env[71051]: INFO networking_nsxv3.common.synchronization [None req-ce4c0cc5-a4f1-40ec-8361-ff7d62ddb339 None None] Enqueued Resource ID: 505fb067-1705-40d6-b6a3-5901d59968c9 with Priority: HIGHEST for action port [ 1425.047810] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505fb067-1705-40d6-b6a3-5901d59968c9 with Priority: HIGHEST for action port [ 1425.047810] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1926e593-dc88-4ca8-93b4-cb9f6bc8f86e [ 1425.047810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.052836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.052836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.054471] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1926e593-dc88-4ca8-93b4-cb9f6bc8f86e already deleted. [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1926e593-dc88-4ca8-93b4-cb9f6bc8f86e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.054471] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-505fb067-1705-40d6-b6a3-5901d59968c9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-505fb067-1705-40d6-b6a3-5901d59968c9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-505fb067-1705-40d6-b6a3-5901d59968c9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.054471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-505fb067-1705-40d6-b6a3-5901d59968c9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.054989] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505fb067-1705-40d6-b6a3-5901d59968c9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.123692] env[71051]: INFO networking_nsxv3.common.synchronization [req-45a29556-57c1-4c10-81fb-0600ae991e52 req-de6e8487-3a2f-4629-9abd-372f39bf198c service nova] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_rules [ 1425.123899] env[71051]: INFO networking_nsxv3.common.synchronization [req-45a29556-57c1-4c10-81fb-0600ae991e52 req-de6e8487-3a2f-4629-9abd-372f39bf198c service nova] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1425.124073] env[71051]: INFO networking_nsxv3.common.synchronization [req-45a29556-57c1-4c10-81fb-0600ae991e52 req-de6e8487-3a2f-4629-9abd-372f39bf198c service nova] Enqueued Resource ID: 2622e3e3-af96-41ab-9040-33c622c4a025 with Priority: HIGHEST for action port [ 1425.124312] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_rules [ 1425.124476] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1425.124578] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2622e3e3-af96-41ab-9040-33c622c4a025 with Priority: HIGHEST for action port [ 1425.125179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.128441] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.128441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.128441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.128441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.128441] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.128441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2622e3e3-af96-41ab-9040-33c622c4a025 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.130810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.130854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.131082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.131082] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2622e3e3-af96-41ab-9040-33c622c4a025',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.150023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ea62961-e317-4c2f-b4d9-668056373014 [ 1425.150023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.150023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.150023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.150023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.150023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.150023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ea62961-e317-4c2f-b4d9-668056373014 already deleted. [ 1425.150023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea62961-e317-4c2f-b4d9-668056373014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.466539] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c611102-ef9e-4425-9ced-e6be888b77ae in Status: SUCCESS [ 1425.466539] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c611102-ef9e-4425-9ced-e6be888b77ae deletion is rescheduled due to dependency. [ 1425.466539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c611102-ef9e-4425-9ced-e6be888b77ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.556738] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 505fb067-1705-40d6-b6a3-5901d59968c9 [ 1425.556979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.557139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.557213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.557433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.557530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.557628] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:505fb067-1705-40d6-b6a3-5901d59968c9 already deleted. [ 1425.557717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-505fb067-1705-40d6-b6a3-5901d59968c9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.633297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.638410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.638410] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2622e3e3-af96-41ab-9040-33c622c4a025 with status ACTIVE [ 1425.638410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.638410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.638410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.638410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.638948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.638948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.638948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.638948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.638948] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2622e3e3-af96-41ab-9040-33c622c4a025 is going to be updated. [ 1425.673099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.673403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.673403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.673525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.675186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.675186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2622e3e3-af96-41ab-9040-33c622c4a025" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.141982] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.645684] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.645955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.645955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.646193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.646239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.646335] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be created. [ 1426.666815] env[71051]: INFO networking_nsxv3.common.synchronization [req-d94a714e-3a44-43c0-b659-3c182c4d646b req-1c539d9d-eb8e-441a-b15c-7716d72e947e tempest-ServersWithSpecificFlavorTestJSON-2113755599 tempest-ServersWithSpecificFlavorTestJSON-2113755599-project-member] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1426.667495] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1426.667785] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.667911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.667963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.668393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.668640] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.668841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.668983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.669246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.669843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.669843] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.671709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.671709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.671846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.672108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.672662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.683807] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: UNINITIALIZED for 2s [ 1426.879292] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: SUCCESS [ 1426.879292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.879292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.879292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.879292] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.879292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.879292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.880804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.881804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.881804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.881804] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.159132] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.159132] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-216" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.159132] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-216" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.162491] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-216" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.162851] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.163010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.163269] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.163414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.163555] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.163774] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1427.163876] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1427.163984] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1427.164120] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1427.164210] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1427.164308] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1427.164448] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1427.176218] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.176218] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.176218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27aac1-26b8-4e44-9313-936316b62525 already deleted. [ 1427.176218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.185328] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1427.185508] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1427.185543] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1427.185690] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-216" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.185996] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-6255a01d-b0d7-44ee-a8f8-f33e99131bad taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.186340] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.186340] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.187235] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.187235] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6255a01d-b0d7-44ee-a8f8-f33e99131bad',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.385325] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.441151] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b741740f-24fd-49f0-82a6-eb37efe7cd7e None None] Enqueued Resource ID: a11c22f1-af58-415e-b1b9-1f8e88317a43 with Priority: HIGHEST for action port [ 1427.441151] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11c22f1-af58-415e-b1b9-1f8e88317a43 with Priority: HIGHEST for action port [ 1427.441151] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a11c22f1-af58-415e-b1b9-1f8e88317a43 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.441334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a11c22f1-af58-415e-b1b9-1f8e88317a43" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.441334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a11c22f1-af58-415e-b1b9-1f8e88317a43" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.441556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a11c22f1-af58-415e-b1b9-1f8e88317a43" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.441641] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a11c22f1-af58-415e-b1b9-1f8e88317a43',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.691045] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.691394] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.691962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.691962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.691962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.692370] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 6255a01d-b0d7-44ee-a8f8-f33e99131bad not found, creating... [ 1427.692370] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.692518] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.692628] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.692854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.692993] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.693321] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.693484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.696835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.696835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.696835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.696835] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 6255a01d-b0d7-44ee-a8f8-f33e99131bad is going to be created. [ 1427.720223] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1af8eb8f-3dd2-4b21-9f6b-10a0981422a9 None None] Enqueued Resource ID: ff6f0d76-d7f2-44f7-80df-990c4fad8128 with Priority: HIGHEST for action port [ 1427.721820] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.722256] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.722350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.722601] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.722827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.723074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.724048] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6f0d76-d7f2-44f7-80df-990c4fad8128 with Priority: HIGHEST for action port [ 1427.724365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff6f0d76-d7f2-44f7-80df-990c4fad8128 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.724495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff6f0d76-d7f2-44f7-80df-990c4fad8128" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.724563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff6f0d76-d7f2-44f7-80df-990c4fad8128" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.724728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff6f0d76-d7f2-44f7-80df-990c4fad8128" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.724824] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff6f0d76-d7f2-44f7-80df-990c4fad8128',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.891021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ae8e1de-8780-45e2-92a4-0586208d5513: rpc.has_security_group_logging(os_id): False [ 1427.891021] env[71051]: INFO networking_nsxv3.common.synchronization [None req-10f1c19b-e575-4385-a812-e4b95ffa5c1c None None] Enqueued Resource ID: e509ce96-ce3e-4e70-9778-1ac4500e8d99 with Priority: HIGHEST for action port [ 1427.891021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509ce96-ce3e-4e70-9778-1ac4500e8d99 with Priority: HIGHEST for action port [ 1427.891943] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e509ce96-ce3e-4e70-9778-1ac4500e8d99 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.892130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e509ce96-ce3e-4e70-9778-1ac4500e8d99" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.892431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e509ce96-ce3e-4e70-9778-1ac4500e8d99" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.892539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e509ce96-ce3e-4e70-9778-1ac4500e8d99" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.892654] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e509ce96-ce3e-4e70-9778-1ac4500e8d99',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.915143] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.915240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.915240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.915663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.915663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.915772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.915853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.915908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.916076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.916159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.916253] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 is going to be created. [ 1427.943814] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a11c22f1-af58-415e-b1b9-1f8e88317a43 [ 1427.944097] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.944276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.944578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.944819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.944917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.945037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a11c22f1-af58-415e-b1b9-1f8e88317a43 already deleted. [ 1427.945125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a11c22f1-af58-415e-b1b9-1f8e88317a43" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.987434] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.989689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.989689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.989984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.991132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.005173] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: IN_PROGRESS for 2s [ 1428.228343] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff6f0d76-d7f2-44f7-80df-990c4fad8128 [ 1428.228590] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.228729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.228798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.229067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.229149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.229251] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff6f0d76-d7f2-44f7-80df-990c4fad8128 already deleted. [ 1428.229431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff6f0d76-d7f2-44f7-80df-990c4fad8128" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.395431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e509ce96-ce3e-4e70-9778-1ac4500e8d99 [ 1428.395701] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.395817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.395889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.396145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.396265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.396311] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e509ce96-ce3e-4e70-9778-1ac4500e8d99 already deleted. [ 1428.396396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e509ce96-ce3e-4e70-9778-1ac4500e8d99" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.694629] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1428.694899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.695120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.696669] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.696669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.696669] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.875675] env[71051]: INFO networking_nsxv3.common.synchronization [req-d94a714e-3a44-43c0-b659-3c182c4d646b req-d6f48550-4c5e-49b3-a990-4894cd790b3a service nova] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1428.875880] env[71051]: INFO networking_nsxv3.common.synchronization [req-d94a714e-3a44-43c0-b659-3c182c4d646b req-d6f48550-4c5e-49b3-a990-4894cd790b3a service nova] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1428.877156] env[71051]: INFO networking_nsxv3.common.synchronization [req-d94a714e-3a44-43c0-b659-3c182c4d646b req-d6f48550-4c5e-49b3-a990-4894cd790b3a service nova] Enqueued Resource ID: 6255a01d-b0d7-44ee-a8f8-f33e99131bad with Priority: HIGHEST for action port [ 1428.878826] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_rules [ 1428.878826] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1428.878826] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6255a01d-b0d7-44ee-a8f8-f33e99131bad with Priority: HIGHEST for action port [ 1428.878826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.878826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.878826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.879063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.879151] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.881830] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.881830] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.881830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.881830] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.888488] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6255a01d-b0d7-44ee-a8f8-f33e99131bad taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.888488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.888488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.888488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.888488] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6255a01d-b0d7-44ee-a8f8-f33e99131bad',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.202606] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.203062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.203062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.203062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.206139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.206139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.206139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.206139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.206139] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.382025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.382025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.388229] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6255a01d-b0d7-44ee-a8f8-f33e99131bad with status ACTIVE [ 1429.388229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.391026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.391026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.391026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.391026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6255a01d-b0d7-44ee-a8f8-f33e99131bad is going to be updated. [ 1429.396031] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.419144] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.419326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.419417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.419725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.419876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.420077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6255a01d-b0d7-44ee-a8f8-f33e99131bad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.708327] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b: rpc.has_security_group_logging(os_id): False [ 1429.725869] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.726162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.726162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.726774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.726774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.726774] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.726774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.726970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.726970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.727065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.727242] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.727332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.727389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.727528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.727600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.727771] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.727854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.727910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.728058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.728139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.728220] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be created. [ 1429.780716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.780890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.780943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.781295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.781482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.793083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1429.901747] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.017057] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: SUCCESS [ 1430.017356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.326564] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b88b4535-a55b-41ce-a22a-807d1d612d03 None None] Enqueued Resource ID: 92f758f7-f14f-4618-b115-bb20e419e689 with Priority: HIGHEST for action port [ 1430.327260] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92f758f7-f14f-4618-b115-bb20e419e689 with Priority: HIGHEST for action port [ 1430.331107] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-92f758f7-f14f-4618-b115-bb20e419e689 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.331107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92f758f7-f14f-4618-b115-bb20e419e689" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.331107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92f758f7-f14f-4618-b115-bb20e419e689" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.331107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92f758f7-f14f-4618-b115-bb20e419e689" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.331107] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92f758f7-f14f-4618-b115-bb20e419e689',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.406885] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.406885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.406885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.407117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.407213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.407317] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27aac1-26b8-4e44-9313-936316b62525 is going to be created. [ 1430.434026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.434026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.434026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.434026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.434026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.440896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: UNINITIALIZED for 2s [ 1430.609788] env[71051]: INFO networking_nsxv3.common.synchronization [None req-29821d90-3a77-4be3-82fb-b2856519de7d None None] Enqueued Resource ID: 7a9fd30e-f6d4-42b9-acea-2009ec0bcf03 with Priority: HIGHEST for action port [ 1430.609788] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9fd30e-f6d4-42b9-acea-2009ec0bcf03 with Priority: HIGHEST for action port [ 1430.613687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a9fd30e-f6d4-42b9-acea-2009ec0bcf03 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.613861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a9fd30e-f6d4-42b9-acea-2009ec0bcf03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.613921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a9fd30e-f6d4-42b9-acea-2009ec0bcf03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.614233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a9fd30e-f6d4-42b9-acea-2009ec0bcf03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.614319] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9fd30e-f6d4-42b9-acea-2009ec0bcf03',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.832483] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92f758f7-f14f-4618-b115-bb20e419e689 [ 1430.833561] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.834048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.834364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.835192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.835416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.835586] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92f758f7-f14f-4618-b115-bb20e419e689 already deleted. [ 1430.835680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92f758f7-f14f-4618-b115-bb20e419e689" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.119155] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a9fd30e-f6d4-42b9-acea-2009ec0bcf03 [ 1431.119449] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.119620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.119678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.119867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.119960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.120070] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a9fd30e-f6d4-42b9-acea-2009ec0bcf03 already deleted. [ 1431.120164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a9fd30e-f6d4-42b9-acea-2009ec0bcf03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.325367] env[71051]: INFO networking_nsxv3.common.synchronization [req-ac5af364-9255-454e-927e-fd0585244931 req-8404d2d8-a9a4-4690-b5c4-0f7670f60190 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1431.326668] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1431.326668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.326668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.326668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.327080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.327117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.327765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.327765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.327765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.327765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.327765] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.367558] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a9fa4c6f-7d63-45f8-8d29-3dd0c74a1204 tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1431.368596] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1431.369385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.369539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.369587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.370037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.370236] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.631058] env[71051]: INFO networking_nsxv3.common.synchronization [None req-45719917-c2f7-4476-856e-4d0b95dc0916 tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1431.631826] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1431.633202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.633324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.760321] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.760321] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.760487] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.761209] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.761209] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.761209] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.761570] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.761570] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.761692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.762463] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1431.762463] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1431.762463] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1431.762463] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1431.762463] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1431.762463] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1431.762704] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1431.786943] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1431.787152] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1431.787331] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1431.787515] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.787847] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.788021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.788146] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.788509] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.788722] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d59a591-9e94-4eaf-9b04-65ed0f5ea404',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.804200] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1431.804408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.830675] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.830675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.830830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.830919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.831025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.831285] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.831387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.831445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.831669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.831669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.831755] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db already deleted. [ 1431.831842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.890589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.891024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.891201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.891755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.892073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.892235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 already deleted. [ 1431.892411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.893176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.893491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.893668] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.294999] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.294999] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.294999] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.294999] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.295490] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.295619] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 not found, creating... [ 1432.296715] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.297773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.297773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.297773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.298185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.298316] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.298594] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.298805] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.299220] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.299844] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.299844] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 is going to be created. [ 1432.320879] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.321196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.321417] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.321699] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.321974] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.322343] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.434215] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.435084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.435084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.435084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.435084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.435084] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 already deleted. [ 1432.435084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.455019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: SUCCESS [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.455019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.455019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.455019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.958734] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.336341] env[71051]: INFO networking_nsxv3.common.synchronization [req-ac5af364-9255-454e-927e-fd0585244931 req-c74a3bbe-094b-4240-9fdd-5f144d87e5a7 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1433.336527] env[71051]: INFO networking_nsxv3.common.synchronization [req-ac5af364-9255-454e-927e-fd0585244931 req-c74a3bbe-094b-4240-9fdd-5f144d87e5a7 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1433.336666] env[71051]: INFO networking_nsxv3.common.synchronization [req-ac5af364-9255-454e-927e-fd0585244931 req-c74a3bbe-094b-4240-9fdd-5f144d87e5a7 service nova] Enqueued Resource ID: 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 with Priority: HIGHEST for action port [ 1433.336900] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1433.337055] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1433.337175] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 with Priority: HIGHEST for action port [ 1433.337726] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.338084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.338084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.338250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.338356] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.339293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.339417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.339498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.339686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.339843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.339954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.340034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.340211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.340304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.340407] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.341447] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.341587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.341657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.345497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.345497] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d59a591-9e94-4eaf-9b04-65ed0f5ea404',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.460988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb27aac1-26b8-4e44-9313-936316b62525: rpc.has_security_group_logging(os_id): False [ 1433.477364] env[71051]: INFO networking_nsxv3.common.synchronization [req-a739c99c-d467-49b3-8b8c-e887be8f87ae req-7ebc7164-e756-40ae-b3e1-f325bb65d217 tempest-ServerExternalEventsTest-79770044 tempest-ServerExternalEventsTest-79770044-project-member] Enqueued Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1433.479138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.479138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.479138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.479541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.479772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.480174] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.480310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.480380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.480661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.480753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.480848] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27aac1-26b8-4e44-9313-936316b62525 is going to be created. [ 1433.483097] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48a7216-9768-452e-a3d9-cf477a05890c with Priority: HIGHEST for action security_group_members [ 1433.483628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a48a7216-9768-452e-a3d9-cf477a05890c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.483745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.483810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.484250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.484984] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.485205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.485292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.485563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.485658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.485760] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a48a7216-9768-452e-a3d9-cf477a05890c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.547902] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.548149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.548149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.548357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.548536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.559215] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: IN_PROGRESS for 2s [ 1433.847114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.847281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.848115] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.848470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 with status ACTIVE [ 1433.848651] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.848776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.848883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.849258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.849368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.849557] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.849661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.849729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.849899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.849983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.852066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.852612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.852706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.853017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.853116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.853212] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d59a591-9e94-4eaf-9b04-65ed0f5ea404 is going to be updated. [ 1433.874310] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.874484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.874484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.874630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.874761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.874923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d59a591-9e94-4eaf-9b04-65ed0f5ea404" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.988753] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.989086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.989086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.989323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.989449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.989567] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.989664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.989741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.989927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.990027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.990119] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a48a7216-9768-452e-a3d9-cf477a05890c is going to be updated. [ 1434.019181] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.019383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.019526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.019675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.019810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.029401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: IN_PROGRESS for 2s [ 1434.064955] env[71051]: INFO networking_nsxv3.common.synchronization [req-f59de7b9-bf6d-4590-8c6d-6bb11724c5f4 req-b00e764f-45e3-4eb8-8e4e-b756918b10fe tempest-FloatingIPsAssociationTestJSON-2072692805 tempest-FloatingIPsAssociationTestJSON-2072692805-project-member] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1434.065498] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1434.066418] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.066549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.066633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.066889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.067065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.067169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.067232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.067394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.067522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.067636] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.357571] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.426925] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.427214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.427410] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.427842] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.428200] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.428454] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.428623] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.428873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.429101] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.429356] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1434.429478] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1434.429591] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1434.429702] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1434.429818] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1434.429924] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1434.430071] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1434.451732] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1434.452942] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1434.452942] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1434.453142] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.453498] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.453673] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.453789] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.454120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.455847] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfbe2c4-619c-4849-b105-0a4bc182ee6a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.573265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.573475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.573561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.573790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.574600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.574600] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.574600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.574600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.574600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.574600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.574600] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe already deleted. [ 1434.574910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.860163] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.860163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.860371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.860415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.860510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.860610] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be created. [ 1434.883143] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.883651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.886454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.886454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.886454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.897089] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: UNINITIALIZED for 2s [ 1434.958139] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.958139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.958139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.958489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.958607] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.958834] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 0bfbe2c4-619c-4849-b105-0a4bc182ee6a not found, creating... [ 1434.959106] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.959381] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.959486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.959741] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.959930] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.962772] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.962772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.962959] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.963171] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.963343] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.963540] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 0bfbe2c4-619c-4849-b105-0a4bc182ee6a is going to be created. [ 1434.982587] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.982587] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.982786] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.983169] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.984325] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.984325] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.571484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: SUCCESS [ 1435.571484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.041400] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a48a7216-9768-452e-a3d9-cf477a05890c in Status: SUCCESS [ 1436.041769] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a48a7216-9768-452e-a3d9-cf477a05890c deletion is rescheduled due to dependency. [ 1436.042107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a48a7216-9768-452e-a3d9-cf477a05890c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.076052] env[71051]: INFO networking_nsxv3.common.synchronization [req-f59de7b9-bf6d-4590-8c6d-6bb11724c5f4 req-2efd7450-6b2e-407f-b38d-56626a10b0c6 service nova] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_rules [ 1436.077098] env[71051]: INFO networking_nsxv3.common.synchronization [req-f59de7b9-bf6d-4590-8c6d-6bb11724c5f4 req-2efd7450-6b2e-407f-b38d-56626a10b0c6 service nova] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1436.077098] env[71051]: INFO networking_nsxv3.common.synchronization [req-f59de7b9-bf6d-4590-8c6d-6bb11724c5f4 req-2efd7450-6b2e-407f-b38d-56626a10b0c6 service nova] Enqueued Resource ID: 0bfbe2c4-619c-4849-b105-0a4bc182ee6a with Priority: HIGHEST for action port [ 1436.077098] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_rules [ 1436.077098] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1436.077098] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bfbe2c4-619c-4849-b105-0a4bc182ee6a with Priority: HIGHEST for action port [ 1436.077526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.077526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.077671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.077975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.078072] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.079509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.079509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.079509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.079509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.079509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.079509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.079957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.079957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.079957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.079957] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.080624] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.080725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.082647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.082647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.082647] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfbe2c4-619c-4849-b105-0a4bc182ee6a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.583655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.583983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.584037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bfbe2c4-619c-4849-b105-0a4bc182ee6a with status ACTIVE [ 1436.584189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.584296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.584358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.584571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.584663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.584836] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.584938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.584985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.585205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.585244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.585411] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.585508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.585567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.585712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.585769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.585850] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bfbe2c4-619c-4849-b105-0a4bc182ee6a is going to be updated. [ 1436.586953] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.619685] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.619796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.620158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.620158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.620318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.620367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bfbe2c4-619c-4849-b105-0a4bc182ee6a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.896797] env[71051]: INFO networking_nsxv3.common.synchronization [req-49c73fbf-0c16-4d9e-8722-80bee4893c46 req-ebaacdff-c81e-4a90-9ec7-5eacfa6045be tempest-ServerDiagnosticsNegativeTest-695430691 tempest-ServerDiagnosticsNegativeTest-695430691-project-member] Enqueued Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1436.897436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1436.898672] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.898823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.898823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.899094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.899250] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.899339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.899802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.899802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.899802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.899802] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.908218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1436.908431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.908584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.908781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.909116] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.909116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.909439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.909439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.909439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.909654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.909654] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.092591] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.402373] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.402756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.402756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.402910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.403131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.403241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.403351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.403428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.403607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.403684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.403790] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 already deleted. [ 1437.403875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.412779] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.413203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.413203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.413338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.413989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.413989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.413989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.414365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.414510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.414619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.415130] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.415231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.415271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.415516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.415594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.415697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.416250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.417236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.417342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.417445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.417569] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.430511] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.430739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.430899] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.431225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.431772] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.431986] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.432177] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.432904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.432904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.432904] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1437.432904] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1437.433228] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1437.433228] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1437.433356] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1437.433564] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1437.433735] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1437.457860] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1437.458402] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1437.461050] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1437.461479] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.461948] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-502983d2-231a-491f-b003-55200836c939 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.462331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.462588] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.463026] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.463313] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502983d2-231a-491f-b003-55200836c939',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.598027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.598027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.598027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.598027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.598027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.598027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be created. [ 1437.622216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.622518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.622518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.623054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.623054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.640935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: UNINITIALIZED for 2s [ 1437.921923] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1437.938377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.938544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.938612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.938842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.938942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.939210] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.939335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.939401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.939583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.939665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.939859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.939957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.940646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.941595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.941595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.941595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.941595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.941595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.941854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.941854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.941954] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be created. [ 1437.966607] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.966607] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.966607] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.967091] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.967091] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.967204] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 502983d2-231a-491f-b003-55200836c939 not found, creating... [ 1437.967592] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.967765] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.967765] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.969320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.969320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.969320] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.969320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.969320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.969320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.969682] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.970494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 502983d2-231a-491f-b003-55200836c939 is going to be created. [ 1437.989831] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.990068] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.990212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.990708] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.991218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.991541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.998962] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.998962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.998962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.999562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.999562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.011685] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1439.133029] env[71051]: INFO networking_nsxv3.common.synchronization [req-49c73fbf-0c16-4d9e-8722-80bee4893c46 req-ad1d9e5f-9a78-4854-b4ba-ef3dfd277721 service nova] Enqueued Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_rules [ 1439.133029] env[71051]: INFO networking_nsxv3.common.synchronization [req-49c73fbf-0c16-4d9e-8722-80bee4893c46 req-ad1d9e5f-9a78-4854-b4ba-ef3dfd277721 service nova] Enqueued Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1439.133029] env[71051]: INFO networking_nsxv3.common.synchronization [req-49c73fbf-0c16-4d9e-8722-80bee4893c46 req-ad1d9e5f-9a78-4854-b4ba-ef3dfd277721 service nova] Enqueued Resource ID: 502983d2-231a-491f-b003-55200836c939 with Priority: HIGHEST for action port [ 1439.133029] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_rules [ 1439.133501] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1439.133501] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 502983d2-231a-491f-b003-55200836c939 with Priority: HIGHEST for action port [ 1439.133805] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.133962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.134019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.137101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.137101] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.137101] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.137101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.137286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.137286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.138455] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.138455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.138455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.138455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.138661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.138661] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.141076] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-502983d2-231a-491f-b003-55200836c939 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.141210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.141269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.141456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.141507] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502983d2-231a-491f-b003-55200836c939',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.643106] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.644728] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 502983d2-231a-491f-b003-55200836c939 with status ACTIVE [ 1439.644728] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.644728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.644728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.644728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.644728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.645040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.645040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.645439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.648620] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.648620] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 502983d2-231a-491f-b003-55200836c939 is going to be updated. [ 1439.648620] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.648620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.658336] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1439.658573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.659057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.659289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.659496] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.659708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.659708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.659853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.659938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.660556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.660719] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.677095] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.677095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.677095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.677095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.678342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.678342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-502983d2-231a-491f-b003-55200836c939" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.026033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1440.026394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.150518] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.165165] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.165165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.165165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.165506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.165506] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.165506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.166105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.166367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.166481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.166609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.166776] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.166890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.166989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.167167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.167323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.167421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.167483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.167627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.167705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.167784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.167942] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.652936] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.653146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.653229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.653460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.653556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.653654] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 is going to be created. [ 1440.673234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd3d690a-4535-4aec-bcff-77d18d84cfbe: rpc.has_security_group_logging(os_id): False [ 1440.679296] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.679856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.679941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.680188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.680341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.690558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.690709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.690778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.691009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.691115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.691441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.691542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.691604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.691916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.691958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.692149] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.692240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.692297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.692641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.692760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.692943] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.693149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.693214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.693340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.693412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.693497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be created. [ 1440.696823] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: UNINITIALIZED for 2s [ 1440.747338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.747338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.747338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.747600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.747600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.759510] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1441.451009] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4342e906-5c05-4c21-b399-cb4404d3c9c4 None None] Enqueued Resource ID: 5c33d2ec-db04-4649-8c67-a74bb5fe40bc with Priority: HIGHEST for action port [ 1441.451724] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c33d2ec-db04-4649-8c67-a74bb5fe40bc with Priority: HIGHEST for action port [ 1441.452139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c33d2ec-db04-4649-8c67-a74bb5fe40bc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.452283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c33d2ec-db04-4649-8c67-a74bb5fe40bc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.452390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c33d2ec-db04-4649-8c67-a74bb5fe40bc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.452680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c33d2ec-db04-4649-8c67-a74bb5fe40bc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.452800] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c33d2ec-db04-4649-8c67-a74bb5fe40bc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.907720] env[71051]: INFO networking_nsxv3.common.synchronization [req-7873aa8d-94e5-49a5-a69a-338741dbe860 req-b51ec932-df24-46c5-ba55-89115d795604 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1441.908279] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1441.908572] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.908689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.908753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.908998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.911719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.911785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.911856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.912049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.912951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.912951] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.954851] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c33d2ec-db04-4649-8c67-a74bb5fe40bc [ 1441.956294] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.956294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.956294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.956294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.956294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.956294] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c33d2ec-db04-4649-8c67-a74bb5fe40bc already deleted. [ 1441.956294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c33d2ec-db04-4649-8c67-a74bb5fe40bc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.419387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.419616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.419706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.420228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.421032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.421032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.421032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.421032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.421415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.421415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.422071] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a already deleted. [ 1442.422071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.424565] env[71051]: INFO networking_nsxv3.common.synchronization [req-94b27359-6ef8-45cd-93d1-311cc784a1ef req-d828e71a-be5f-4586-9485-e7a44f696f16 tempest-FloatingIPsAssociationNegativeTestJSON-1679587902 tempest-FloatingIPsAssociationNegativeTestJSON-1679587902-project-member] Enqueued Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1442.425226] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGHEST for action security_group_members [ 1442.426100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.426486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.426486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.427094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.427094] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.427094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.427094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.427094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.427780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.427780] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.568500] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2288aed9-20be-4125-94d4-deaa13ac2470 None None] Enqueued Resource ID: 4c2bd2ec-d0f2-44aa-b44a-62f01c106014 with Priority: HIGHEST for action port [ 1442.569602] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2bd2ec-d0f2-44aa-b44a-62f01c106014 with Priority: HIGHEST for action port [ 1442.569711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c2bd2ec-d0f2-44aa-b44a-62f01c106014 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.570028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c2bd2ec-d0f2-44aa-b44a-62f01c106014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.570028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c2bd2ec-d0f2-44aa-b44a-62f01c106014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.571468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c2bd2ec-d0f2-44aa-b44a-62f01c106014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.571748] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c2bd2ec-d0f2-44aa-b44a-62f01c106014',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.707302] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: SUCCESS [ 1442.707302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.707302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.707302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.707521] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.707582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.707621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.708097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.708097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.708097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.708097] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.774813] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1442.774927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.932316] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.932316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.932509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.932625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.932864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.932947] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.933045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.933258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.933292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.933451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.933451] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 is going to be updated. [ 1442.961255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.963543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.963543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.963543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.963543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.972915] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: IN_PROGRESS for 2s [ 1443.075668] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c2bd2ec-d0f2-44aa-b44a-62f01c106014 [ 1443.075668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.075668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.075668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.075841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.075841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.076320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c2bd2ec-d0f2-44aa-b44a-62f01c106014 already deleted. [ 1443.076320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c2bd2ec-d0f2-44aa-b44a-62f01c106014" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.083416] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.083683] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.083971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.084240] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.084557] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.084732] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.084863] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.085099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.087546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.087546] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1443.087546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1443.087546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1443.087546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1443.087546] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1443.087546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1443.087546] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1443.107870] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1443.107991] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1443.108162] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1443.109046] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.109557] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.109754] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.109874] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.110267] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.110568] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a483a5b4-d244-4d85-ac5e-f4d0d95d845f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.214445] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.214445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.214445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.214445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.214768] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.214828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.216196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.216196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.216196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.216760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.217321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.217550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.217733] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.217957] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.614739] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.617534] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.617534] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.617534] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.617534] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.617534] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a483a5b4-d244-4d85-ac5e-f4d0d95d845f not found, creating... [ 1443.617770] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.617942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.618077] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.618328] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.618489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.618835] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.618998] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.620012] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.620148] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.620323] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.620506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a483a5b4-d244-4d85-ac5e-f4d0d95d845f is going to be created. [ 1443.649763] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.649889] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.649923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.650257] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.650541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.650793] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.689010] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8baf3af9-c76b-42eb-8007-2508a7799d51 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1443.689929] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1443.690073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.690269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.690828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.690983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.691123] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.723345] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abff08ff-fc06-4dbe-a011-a141e9aba9d4: rpc.has_security_group_logging(os_id): False [ 1443.750260] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.750260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.750260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.750499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.750672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.750928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.751058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.751127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.751440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.751529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.751733] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.751832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.751895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.752878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.752978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.753212] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.753319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.753384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.753635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.753719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.753811] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 is going to be created. [ 1443.818294] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.818294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.818861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.818861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.818861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.833806] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: IN_PROGRESS for 2s [ 1443.961980] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a775c2a2-b9e2-4bad-baea-28da8dbb9cf6 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1443.962680] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1443.966370] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.966370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.210592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.210903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.211014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.211641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.211641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.211641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 already deleted. [ 1444.211641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.211824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.211873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.211975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.630668] env[71051]: INFO networking_nsxv3.common.synchronization [req-23b7d52e-8974-434e-a5e0-42ee51ace95f req-171c78b1-be88-4261-a551-cc92faf70908 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1444.631323] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1444.631451] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.631573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.632677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.632677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.632868] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.632868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.632964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.635201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.635201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.635201] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.666303] env[71051]: INFO networking_nsxv3.common.synchronization [None req-199cb558-c365-4c89-83f6-3946c187bc18 None None] Enqueued Resource ID: 8bb98aab-6bb2-4e0d-8292-55f9784965b7 with Priority: HIGHEST for action port [ 1444.667516] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb98aab-6bb2-4e0d-8292-55f9784965b7 with Priority: HIGHEST for action port [ 1444.667888] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb98aab-6bb2-4e0d-8292-55f9784965b7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.669072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb98aab-6bb2-4e0d-8292-55f9784965b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.669143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb98aab-6bb2-4e0d-8292-55f9784965b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.669398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb98aab-6bb2-4e0d-8292-55f9784965b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.669487] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb98aab-6bb2-4e0d-8292-55f9784965b7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.730240] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.730329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.730368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.730561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.730664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.730760] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 already deleted. [ 1444.730847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.957113] env[71051]: INFO networking_nsxv3.common.synchronization [None req-cf884d19-0815-4ca7-ba2a-3459206a7023 None None] Enqueued Resource ID: 4ff7cd3f-aec0-4669-bef1-7b4c7509a043 with Priority: HIGHEST for action port [ 1444.957113] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff7cd3f-aec0-4669-bef1-7b4c7509a043 with Priority: HIGHEST for action port [ 1444.957113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff7cd3f-aec0-4669-bef1-7b4c7509a043 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.957113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff7cd3f-aec0-4669-bef1-7b4c7509a043" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.957113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff7cd3f-aec0-4669-bef1-7b4c7509a043" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.957113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff7cd3f-aec0-4669-bef1-7b4c7509a043" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.957113] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff7cd3f-aec0-4669-bef1-7b4c7509a043',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.977813] env[71051]: INFO networking_nsxv3.common.synchronization [req-7873aa8d-94e5-49a5-a69a-338741dbe860 req-578d0152-de05-4176-875e-c95b21a808b6 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1444.978628] env[71051]: INFO networking_nsxv3.common.synchronization [req-7873aa8d-94e5-49a5-a69a-338741dbe860 req-578d0152-de05-4176-875e-c95b21a808b6 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1444.978628] env[71051]: INFO networking_nsxv3.common.synchronization [req-7873aa8d-94e5-49a5-a69a-338741dbe860 req-578d0152-de05-4176-875e-c95b21a808b6 service nova] Enqueued Resource ID: a483a5b4-d244-4d85-ac5e-f4d0d95d845f with Priority: HIGHEST for action port [ 1444.979249] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1444.979249] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1444.979249] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a483a5b4-d244-4d85-ac5e-f4d0d95d845f with Priority: HIGHEST for action port [ 1444.980361] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.980804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.980804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.981384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.981384] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.982337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.982337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.982663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.982925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.983129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.983273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.983365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.983568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.983686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.984033] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.989191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.989191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.989191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.989191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.989191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a483a5b4-d244-4d85-ac5e-f4d0d95d845f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.989191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 in Status: SUCCESS [ 1444.989191] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 deletion is rescheduled due to dependency. [ 1444.989568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.136700] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.136700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.137040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.137095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.137364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.137441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.137912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.137912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.137912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.138580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.139642] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 already deleted. [ 1445.139818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.172208] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bb98aab-6bb2-4e0d-8292-55f9784965b7 [ 1445.172362] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.172491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.172554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.172759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.172838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.172933] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bb98aab-6bb2-4e0d-8292-55f9784965b7 already deleted. [ 1445.173026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb98aab-6bb2-4e0d-8292-55f9784965b7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.213104] env[71051]: INFO networking_nsxv3.common.synchronization [req-10e92205-0064-40a5-a381-5eeae14dfc29 req-edc7d1e5-e0c9-4309-8b49-f0fc6df3196b tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1445.213694] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1445.214074] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.214199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.214329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.214665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.214859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.215321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.215321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.215321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.215613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.215613] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.389064] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4091a5dd-b339-4222-87e4-e863093d5501 tempest-ServersTestBootFromVolume-2134801246 tempest-ServersTestBootFromVolume-2134801246-project-member] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1445.389064] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1445.389064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.389064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.389064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.389064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.389064] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.459024] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff7cd3f-aec0-4669-bef1-7b4c7509a043 [ 1445.460344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.460344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.460344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.460344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.460704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.460704] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff7cd3f-aec0-4669-bef1-7b4c7509a043 already deleted. [ 1445.460704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff7cd3f-aec0-4669-bef1-7b4c7509a043" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.493287] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.494136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.494136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.494136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a483a5b4-d244-4d85-ac5e-f4d0d95d845f with status ACTIVE [ 1445.494136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.494477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.494477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.494477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.494582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.498019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.498019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.498019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.498019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a483a5b4-d244-4d85-ac5e-f4d0d95d845f is going to be updated. [ 1445.518273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.518273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.518273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.518273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.518273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.518273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a483a5b4-d244-4d85-ac5e-f4d0d95d845f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.566065] env[71051]: INFO networking_nsxv3.common.synchronization [None req-60c80dd0-b3f4-4ffb-a2ed-8128fb585f13 tempest-ServersTestBootFromVolume-2134801246 tempest-ServersTestBootFromVolume-2134801246-project-member] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1445.566854] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1445.566945] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.567023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.589832] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.589832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-908" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.589832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-908" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.589832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-908" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.589832] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.589832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.591953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.592327] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.592408] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.592574] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1445.596033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1445.596033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1445.596033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1445.596033] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1445.596033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1445.596033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1445.612033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1445.612033] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1445.612033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1445.612630] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-908" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.614326] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-3bf6c714-254d-49f5-be2c-a97817639fde taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.614326] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.614326] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.614326] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.614326] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf6c714-254d-49f5-be2c-a97817639fde',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.721516] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.721516] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.721516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.721516] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1445.759027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.759027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.759027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.759027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.759027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.766237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1445.844498] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: SUCCESS [ 1445.844700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.916028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.916028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 already deleted. [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.916028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.916028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.998860] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.007800] env[71051]: INFO networking_nsxv3.common.synchronization [None req-ce5a6d1a-2e6e-4f15-b813-7314320009ac None None] Enqueued Resource ID: 2a26e6d7-91e0-4683-a63d-7ed1f70804d5 with Priority: HIGHEST for action port [ 1446.009228] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a26e6d7-91e0-4683-a63d-7ed1f70804d5 with Priority: HIGHEST for action port [ 1446.009228] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a26e6d7-91e0-4683-a63d-7ed1f70804d5 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.009228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a26e6d7-91e0-4683-a63d-7ed1f70804d5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.009228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a26e6d7-91e0-4683-a63d-7ed1f70804d5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.009461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a26e6d7-91e0-4683-a63d-7ed1f70804d5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.009461] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a26e6d7-91e0-4683-a63d-7ed1f70804d5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.119788] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.123210] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 3bf6c714-254d-49f5-be2c-a97817639fde not found, creating... [ 1446.123210] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.123210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.123885] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.124505] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.125313] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.125683] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.126971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.127249] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 3bf6c714-254d-49f5-be2c-a97817639fde is going to be created. [ 1446.149308] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.149644] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.149729] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.150021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.150259] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.150493] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.436994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.436994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.437287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.437335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.437517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.437517] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 already deleted. [ 1446.437680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.502639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.502778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.502888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.503324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.503324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.503324] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be created. [ 1446.512595] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a26e6d7-91e0-4683-a63d-7ed1f70804d5 [ 1446.512971] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.512971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.512971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.513255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.513318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.513377] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a26e6d7-91e0-4683-a63d-7ed1f70804d5 already deleted. [ 1446.513440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a26e6d7-91e0-4683-a63d-7ed1f70804d5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.524315] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.524478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.524533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.524778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.524930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.536058] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: UNINITIALIZED for 2s [ 1447.041295] env[71051]: INFO networking_nsxv3.common.synchronization [None req-59f28ab0-d0c8-4bdf-acb8-efd91a33a0e2 None None] Enqueued Resource ID: e119bd41-6d70-4e8a-ac19-efe8b1b913ad with Priority: HIGHEST for action port [ 1447.045562] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e119bd41-6d70-4e8a-ac19-efe8b1b913ad with Priority: HIGHEST for action port [ 1447.045562] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e119bd41-6d70-4e8a-ac19-efe8b1b913ad taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.045562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e119bd41-6d70-4e8a-ac19-efe8b1b913ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.046105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e119bd41-6d70-4e8a-ac19-efe8b1b913ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.046105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e119bd41-6d70-4e8a-ac19-efe8b1b913ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.046397] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e119bd41-6d70-4e8a-ac19-efe8b1b913ad',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [req-23b7d52e-8974-434e-a5e0-42ee51ace95f req-f1787392-d49b-420a-955d-32f73df795fa service nova] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [req-23b7d52e-8974-434e-a5e0-42ee51ace95f req-f1787392-d49b-420a-955d-32f73df795fa service nova] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [req-23b7d52e-8974-434e-a5e0-42ee51ace95f req-f1787392-d49b-420a-955d-32f73df795fa service nova] Enqueued Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1447.131026] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1447.131026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.131543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.131543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.134938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.134938] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.134938] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.134938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.134938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.134938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.135330] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.137140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.137202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.138444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.138444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.138444] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.139147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bf6c714-254d-49f5-be2c-a97817639fde taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.139387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.139387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.139747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.139831] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf6c714-254d-49f5-be2c-a97817639fde',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.367370] env[71051]: INFO networking_nsxv3.common.synchronization [req-fa09f181-13bb-4fc6-bf01-94f21c6d4c16 req-45d6625d-f568-40b7-be13-e4c86c0fbb92 tempest-ServerTagsTestJSON-128364070 tempest-ServerTagsTestJSON-128364070-project-member] Enqueued Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1447.367932] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1447.368250] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.368372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.368430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.368691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.369033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.369033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.369033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.369263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.369326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.369522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.550548] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e119bd41-6d70-4e8a-ac19-efe8b1b913ad [ 1447.550994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.554207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.554207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.554207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.554207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.554207] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e119bd41-6d70-4e8a-ac19-efe8b1b913ad already deleted. [ 1447.554207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e119bd41-6d70-4e8a-ac19-efe8b1b913ad" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.643496] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.643688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.644683] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.644945] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bf6c714-254d-49f5-be2c-a97817639fde with status ACTIVE [ 1447.644993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.645133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.645345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.646136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.646136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.646136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.646136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.646136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.646136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.646849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.650037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.650037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.650037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.650037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.650037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.650037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bf6c714-254d-49f5-be2c-a97817639fde is going to be updated. [ 1447.677599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.677784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.677859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.678113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.678247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.678410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.783054] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1447.783054] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1447.783054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.875392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.875392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.875392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.876187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.876187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.876187] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 already deleted. [ 1447.876187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.066760] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.066760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-514" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.066760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-514" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.067209] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-514" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.069754] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.069754] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.069754] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.069754] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.069754] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.069754] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.069754] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1448.069754] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1448.069754] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1448.069754] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.070199] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1448.070199] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1448.093988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1448.094255] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1448.094917] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1448.094917] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-514" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.095172] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-133aa5f9-d262-4d9d-b803-37a575585457 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.095421] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.095604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.096905] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.097125] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('133aa5f9-d262-4d9d-b803-37a575585457',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.150396] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.550363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1448.550564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.551016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.551402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.551655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.552381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.552381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.552381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.552381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.552641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.552641] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.599596] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.599889] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.600159] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.600542] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.600723] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.601055] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 133aa5f9-d262-4d9d-b803-37a575585457 not found, creating... [ 1448.601212] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.601428] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.601558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.601876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.602075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.602432] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.602614] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.602962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.603258] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.603476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.603476] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 133aa5f9-d262-4d9d-b803-37a575585457 is going to be created. [ 1448.636660] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.636926] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.636986] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.637291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.637731] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.637731] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.654498] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.656755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.656755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.656755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.656755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.656755] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be created. [ 1448.686964] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.687132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.687223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.687508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.687713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.700352] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: UNINITIALIZED for 2s [ 1448.945220] env[71051]: INFO networking_nsxv3.common.synchronization [None req-f624e72c-0f71-4392-9e1d-2dcb60a5f3ea None None] Enqueued Resource ID: 2bd614e6-20e0-4a7e-837c-42b20fa5d17c with Priority: HIGHEST for action port [ 1448.945917] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd614e6-20e0-4a7e-837c-42b20fa5d17c with Priority: HIGHEST for action port [ 1448.946643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd614e6-20e0-4a7e-837c-42b20fa5d17c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.946764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd614e6-20e0-4a7e-837c-42b20fa5d17c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.947244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd614e6-20e0-4a7e-837c-42b20fa5d17c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.949307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd614e6-20e0-4a7e-837c-42b20fa5d17c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.949452] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd614e6-20e0-4a7e-837c-42b20fa5d17c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.006027] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4b4524eb-04c8-489d-8bb0-d63c6ddf0bae None None] Enqueued Resource ID: 6c0b48c8-3355-4729-8b6c-8c6ce88aed7e with Priority: HIGHEST for action port [ 1449.006027] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b48c8-3355-4729-8b6c-8c6ce88aed7e with Priority: HIGHEST for action port [ 1449.006027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c0b48c8-3355-4729-8b6c-8c6ce88aed7e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.006027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c0b48c8-3355-4729-8b6c-8c6ce88aed7e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.006027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c0b48c8-3355-4729-8b6c-8c6ce88aed7e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.006479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c0b48c8-3355-4729-8b6c-8c6ce88aed7e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.006479] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c0b48c8-3355-4729-8b6c-8c6ce88aed7e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.054747] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.054913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.055012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.055233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.055414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.055717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.055717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.055717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.055885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.055939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.056147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.056273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.056319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.056454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.056595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.056686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.057437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.057437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.057437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.057437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.057437] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.452156] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bd614e6-20e0-4a7e-837c-42b20fa5d17c [ 1449.452156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.452156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.452156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.453205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.453205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.453205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bd614e6-20e0-4a7e-837c-42b20fa5d17c already deleted. [ 1449.453447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd614e6-20e0-4a7e-837c-42b20fa5d17c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.509875] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c0b48c8-3355-4729-8b6c-8c6ce88aed7e [ 1449.509875] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.509875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.509875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.509875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.509875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.509875] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c0b48c8-3355-4729-8b6c-8c6ce88aed7e already deleted. [ 1449.509875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c0b48c8-3355-4729-8b6c-8c6ce88aed7e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.560634] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49e506d-62f2-4518-a039-ac618500914a: rpc.has_security_group_logging(os_id): False [ 1449.577257] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.577416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.577485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.577793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.577898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.578109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.578222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.578291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.578429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.578500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.578697] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.578797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.578860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.578981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.580455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.580727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.580841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.580908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.581076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.581152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.581256] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be created. [ 1449.634200] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.634200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.634335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.634471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.634655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.667501] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1449.682428] env[71051]: INFO networking_nsxv3.common.synchronization [req-fa09f181-13bb-4fc6-bf01-94f21c6d4c16 req-2b904697-5bad-4185-9c5d-fc217d9e5399 service nova] Enqueued Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_rules [ 1449.683818] env[71051]: INFO networking_nsxv3.common.synchronization [req-fa09f181-13bb-4fc6-bf01-94f21c6d4c16 req-2b904697-5bad-4185-9c5d-fc217d9e5399 service nova] Enqueued Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1449.683818] env[71051]: INFO networking_nsxv3.common.synchronization [req-fa09f181-13bb-4fc6-bf01-94f21c6d4c16 req-2b904697-5bad-4185-9c5d-fc217d9e5399 service nova] Enqueued Resource ID: 133aa5f9-d262-4d9d-b803-37a575585457 with Priority: HIGHEST for action port [ 1449.683818] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_rules [ 1449.685973] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1449.685973] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 133aa5f9-d262-4d9d-b803-37a575585457 with Priority: HIGHEST for action port [ 1449.685973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.685973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.685973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.685973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.685973] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.686397] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.686397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.686397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.686565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.686991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.686991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.686991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.687232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.687232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.687232] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.693152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-133aa5f9-d262-4d9d-b803-37a575585457 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.693152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.693834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.693834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.693834] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('133aa5f9-d262-4d9d-b803-37a575585457',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.195423] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.196484] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.196642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.196852] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 133aa5f9-d262-4d9d-b803-37a575585457 with status ACTIVE [ 1450.196946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.197049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.197112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.197288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.197376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.197667] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.197789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.197854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.197998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.198104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.198261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.198373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.198436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.198853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.198853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.198853] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 133aa5f9-d262-4d9d-b803-37a575585457 is going to be updated. [ 1450.221408] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.221612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.221692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.221912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.222056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.222219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-133aa5f9-d262-4d9d-b803-37a575585457" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.706192] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.711110] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1450.711283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.711460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.711688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.712505] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.712706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.712799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.712984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.713104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.713201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.713297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.210963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.210963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.210963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.210963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.210963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.210963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 is going to be created. [ 1451.216347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.216347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.216347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.216347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.216593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.216593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.216680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.216875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.217044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.217203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.217455] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.219189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.219189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.219189] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.234572] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.234736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.234805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.235047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.235211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.244257] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: UNINITIALIZED for 2s [ 1451.680443] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1451.680776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.722698] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f22ee43-f198-4147-acc9-db3dc0e103a2: rpc.has_security_group_logging(os_id): False [ 1451.745555] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.745555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.745555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.745555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.746999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.747333] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.747618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.747618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.747759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.747846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.748078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.748603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.749045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.749045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.749045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.749399] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.749731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.749731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.750017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.750017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.750165] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be created. [ 1451.805726] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.806643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.806643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.806643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.806643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.817012] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1452.655322] env[71051]: INFO networking_nsxv3.common.synchronization [req-55150d7b-1556-4719-9d32-d1a0c06f3b82 req-28e801ec-2a74-42a6-877c-efb7ccd8d1ba tempest-ServerDiagnosticsNegativeTest-695430691 tempest-ServerDiagnosticsNegativeTest-695430691-project-member] Enqueued Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1452.655322] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 with Priority: HIGHEST for action security_group_members [ 1452.655322] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-abff08ff-fc06-4dbe-a011-a141e9aba9d4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.655322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.655322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.656249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.656429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.656600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.656600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.656825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.656925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.657079] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abff08ff-fc06-4dbe-a011-a141e9aba9d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.162536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.162968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.162968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.163118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.163172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.163371] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.163539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.163776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.163962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.164302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.164444] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 is going to be updated. [ 1453.194572] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.194775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.194850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.195016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.195174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.204539] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: IN_PROGRESS for 2s [ 1453.254048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: SUCCESS [ 1453.254299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.254457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.254710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.254958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.255105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.255175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.255370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.255485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.255583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.255707] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.762068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.762068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.762068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.762068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.762068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.763180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.763180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.763180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.763180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.763180] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.829735] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1453.830134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.264264] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 042bdb74-254e-4d12-a03c-f947b0627cf4: rpc.has_security_group_logging(os_id): False [ 1454.282513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.282674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.282747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.282967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.283083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.283276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.283409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.283452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.283619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.283696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.283878] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.284136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.284136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.284211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.284288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.284494] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.284549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.284608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.284764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.284838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.286531] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 is going to be created. [ 1454.305971] env[71051]: INFO networking_nsxv3.common.synchronization [req-878fcdc9-ced2-48ad-a90b-3f9b80f6508c req-61f84a17-c908-4199-8694-4602485dcf72 tempest-ServersV294TestFqdnHostnames-1299815983 tempest-ServersV294TestFqdnHostnames-1299815983-project-member] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1454.306520] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1454.306812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.306931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.306996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.307256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.307402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.307497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.308844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.308844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.308844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.308844] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.350066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.350066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.350066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.350066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.350066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.360543] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: IN_PROGRESS for 2s [ 1454.810203] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.810324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.810384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.810604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.811363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.811363] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.811363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.811363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.811584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.811749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.812387] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 already deleted. [ 1454.812387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.965844] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.966106] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-744" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.966248] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-744" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.966573] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-744" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.966751] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.966905] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.967718] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.968021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.968177] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.968488] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1454.968580] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1454.968624] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1454.968725] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1454.968832] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1454.968940] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1454.969088] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1454.987441] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1454.987640] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1454.987640] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1454.987976] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-744" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.988143] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-30d05257-7c83-45ce-a025-feb34dde1f08 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.988320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.988478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.988862] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.988957] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30d05257-7c83-45ce-a025-feb34dde1f08',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.218073] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 in Status: SUCCESS [ 1455.218785] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abff08ff-fc06-4dbe-a011-a141e9aba9d4 deletion is rescheduled due to dependency. [ 1455.218785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abff08ff-fc06-4dbe-a011-a141e9aba9d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.494216] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.494670] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.494670] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.494904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.495078] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.496121] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 30d05257-7c83-45ce-a025-feb34dde1f08 not found, creating... [ 1455.496121] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.496121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.496121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.496121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.496121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.496514] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.496576] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.496708] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.497982] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.498192] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.498494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 30d05257-7c83-45ce-a025-feb34dde1f08 is going to be created. [ 1455.522010] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.522010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.522010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.522010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.522010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.522010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.194300] env[71051]: INFO networking_nsxv3.common.synchronization [None req-06402e9f-c825-4c66-8294-5829baf88734 None None] Enqueued Resource ID: b54408df-755e-4e0a-9e3a-bd91503fcbd0 with Priority: HIGHEST for action port [ 1456.194407] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54408df-755e-4e0a-9e3a-bd91503fcbd0 with Priority: HIGHEST for action port [ 1456.194677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b54408df-755e-4e0a-9e3a-bd91503fcbd0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.194804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b54408df-755e-4e0a-9e3a-bd91503fcbd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.194884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b54408df-755e-4e0a-9e3a-bd91503fcbd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.195422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b54408df-755e-4e0a-9e3a-bd91503fcbd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.195493] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b54408df-755e-4e0a-9e3a-bd91503fcbd0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.375057] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: SUCCESS [ 1456.375304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.700399] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b54408df-755e-4e0a-9e3a-bd91503fcbd0 [ 1456.700687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.700766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.700866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.701061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.701154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.701251] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b54408df-755e-4e0a-9e3a-bd91503fcbd0 already deleted. [ 1456.701368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b54408df-755e-4e0a-9e3a-bd91503fcbd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.808866] env[71051]: INFO networking_nsxv3.common.synchronization [req-878fcdc9-ced2-48ad-a90b-3f9b80f6508c req-0ad8f703-0760-4a94-8ffa-82016d464367 service nova] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1456.809076] env[71051]: INFO networking_nsxv3.common.synchronization [req-878fcdc9-ced2-48ad-a90b-3f9b80f6508c req-0ad8f703-0760-4a94-8ffa-82016d464367 service nova] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1456.809241] env[71051]: INFO networking_nsxv3.common.synchronization [req-878fcdc9-ced2-48ad-a90b-3f9b80f6508c req-0ad8f703-0760-4a94-8ffa-82016d464367 service nova] Enqueued Resource ID: 30d05257-7c83-45ce-a025-feb34dde1f08 with Priority: HIGHEST for action port [ 1456.809503] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_rules [ 1456.809634] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1456.809732] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d05257-7c83-45ce-a025-feb34dde1f08 with Priority: HIGHEST for action port [ 1456.810446] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.810628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.810732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.810964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.811509] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.812972] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.813395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.813493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.813682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.814461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.814461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.814461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.814853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.814853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.814853] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.818769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-30d05257-7c83-45ce-a025-feb34dde1f08 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.818769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.818769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.818769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.818769] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30d05257-7c83-45ce-a025-feb34dde1f08',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.017813] env[71051]: INFO networking_nsxv3.common.synchronization [req-c311d15f-6a40-47d4-8f1a-ffe49c09d445 req-11fb6279-30e5-498e-ab92-0aa79185b455 tempest-ServersAdminNegativeTestJSON-889609971 tempest-ServersAdminNegativeTestJSON-889609971-project-member] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1457.018749] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1457.019189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.019310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.019388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.020139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.020139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.020139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.020139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.020139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.020468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.021729] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.318102] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.324831] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30d05257-7c83-45ce-a025-feb34dde1f08 with status ACTIVE [ 1457.326169] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.326169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.326169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.326169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.326169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.326169] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.326169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.326566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.326566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.326566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.326696] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.326790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.326845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.327149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.327149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.327267] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30d05257-7c83-45ce-a025-feb34dde1f08 is going to be updated. [ 1457.328944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.329105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.349113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.349489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.349489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.349571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.349711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.349878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30d05257-7c83-45ce-a025-feb34dde1f08" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.526029] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.825258] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.858779] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.859372] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.859629] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.859982] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.860619] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.860809] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.861045] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.862176] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.862430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.864189] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1457.864189] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1457.864189] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1457.864189] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1457.864189] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1457.864189] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1457.864189] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1457.884226] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1457.884415] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1457.884653] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1457.884742] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.885232] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-182815af-2ebf-49d1-814e-a16fb7e5f3f2 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.885390] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.885390] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.885870] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.886047] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182815af-2ebf-49d1-814e-a16fb7e5f3f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.028550] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.155616] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1a0d85ad-cd99-4439-b9be-dd018f6f9cb5 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1458.156180] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1458.156487] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.156639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.156704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.157092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.157092] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.285436] env[71051]: INFO networking_nsxv3.common.synchronization [None req-734a12e7-3ee2-4364-8dad-66c883dc9259 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1458.285436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1458.287639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.287639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.333309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.333309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.333309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.333309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.333309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.333309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 is going to be created. [ 1458.357951] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.358122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.358192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.358645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.358812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.385480] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: UNINITIALIZED for 2s [ 1458.389975] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.390490] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.390649] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.390953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.391123] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.391354] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 182815af-2ebf-49d1-814e-a16fb7e5f3f2 not found, creating... [ 1458.391744] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.391928] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.392070] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.392336] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.392475] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.392797] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.392955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.394426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.394873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.394873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.395072] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 182815af-2ebf-49d1-814e-a16fb7e5f3f2 is going to be created. [ 1458.425580] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.425580] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.425803] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.426148] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.426501] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.427479] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.455614] env[71051]: INFO networking_nsxv3.common.synchronization [None req-dbd9d970-eae2-4453-bf94-003a04d005bf None None] Enqueued Resource ID: 38909dd5-9848-4b6b-a681-0daa13d96f09 with Priority: HIGHEST for action port [ 1458.456798] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38909dd5-9848-4b6b-a681-0daa13d96f09 with Priority: HIGHEST for action port [ 1458.457698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-38909dd5-9848-4b6b-a681-0daa13d96f09 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.457894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38909dd5-9848-4b6b-a681-0daa13d96f09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.457991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38909dd5-9848-4b6b-a681-0daa13d96f09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.458319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38909dd5-9848-4b6b-a681-0daa13d96f09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.458425] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38909dd5-9848-4b6b-a681-0daa13d96f09',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.534960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.534960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.534960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.534960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.534960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.534960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be updated. [ 1458.570495] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.570709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.570709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.570929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.571112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.582687] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1458.698731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.698878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.698947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.699207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.699317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.699416] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b939b9-34f2-43da-9107-07642c640846 already deleted. [ 1458.700371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.700638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.700869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.700960] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.962458] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38909dd5-9848-4b6b-a681-0daa13d96f09 [ 1458.962897] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.962897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.963049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.963858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.963858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.963858] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38909dd5-9848-4b6b-a681-0daa13d96f09 already deleted. [ 1458.963858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38909dd5-9848-4b6b-a681-0daa13d96f09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.156887] env[71051]: INFO networking_nsxv3.common.synchronization [None req-ebee3bbf-ea1a-40bf-969e-c3cce40cc665 None None] Enqueued Resource ID: 0e359505-c4e0-4d01-af52-6c9e14807b53 with Priority: HIGHEST for action port [ 1459.157177] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e359505-c4e0-4d01-af52-6c9e14807b53 with Priority: HIGHEST for action port [ 1459.162693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e359505-c4e0-4d01-af52-6c9e14807b53 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.162975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e359505-c4e0-4d01-af52-6c9e14807b53" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.163166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e359505-c4e0-4d01-af52-6c9e14807b53" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.163511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e359505-c4e0-4d01-af52-6c9e14807b53" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.163673] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e359505-c4e0-4d01-af52-6c9e14807b53',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.221587] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.221802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.221802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.222048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.222158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.222278] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b939b9-34f2-43da-9107-07642c640846 already deleted. [ 1459.222381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.671219] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e359505-c4e0-4d01-af52-6c9e14807b53 [ 1459.671219] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.671219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.671219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.671219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.671219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.671219] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e359505-c4e0-4d01-af52-6c9e14807b53 already deleted. [ 1459.671219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e359505-c4e0-4d01-af52-6c9e14807b53" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [req-c311d15f-6a40-47d4-8f1a-ffe49c09d445 req-b863e3db-3dd6-4833-b943-9f9ed23506cb service nova] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_rules [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [req-c311d15f-6a40-47d4-8f1a-ffe49c09d445 req-b863e3db-3dd6-4833-b943-9f9ed23506cb service nova] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [req-c311d15f-6a40-47d4-8f1a-ffe49c09d445 req-b863e3db-3dd6-4833-b943-9f9ed23506cb service nova] Enqueued Resource ID: 182815af-2ebf-49d1-814e-a16fb7e5f3f2 with Priority: HIGHEST for action port [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_rules [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1459.687539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182815af-2ebf-49d1-814e-a16fb7e5f3f2 with Priority: HIGHEST for action port [ 1459.687920] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.691432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.691585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.691872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.692022] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.693309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.693444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.693853] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-182815af-2ebf-49d1-814e-a16fb7e5f3f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.693853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.693853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.694031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.694078] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182815af-2ebf-49d1-814e-a16fb7e5f3f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.768635] env[71051]: INFO networking_nsxv3.common.synchronization [None req-33c93c61-a34e-4671-a3fd-ec2df637016a tempest-ServerActionsV293TestJSON-1541438298 tempest-ServerActionsV293TestJSON-1541438298-project-member] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1459.769252] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1459.769561] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.769698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.769758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.770068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.770166] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.833115] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-098a886f-a0ad-46d3-86ef-21587ee5c644 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1459.834031] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1459.837368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.837368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.837368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.837368] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.925044] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fb87269b-9571-41a8-aef1-5e7b16a50aca tempest-ServerActionsV293TestJSON-1541438298 tempest-ServerActionsV293TestJSON-1541438298-project-member] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1459.925381] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1459.926090] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.926090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.198698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.199063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.199246] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 182815af-2ebf-49d1-814e-a16fb7e5f3f2 with status ACTIVE [ 1460.199536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.199717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.199826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.200458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.200458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.200591] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.202257] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.202257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.202734] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 182815af-2ebf-49d1-814e-a16fb7e5f3f2 is going to be updated. [ 1460.224817] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.225071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.226590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.226590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.226590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.226590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-182815af-2ebf-49d1-814e-a16fb7e5f3f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.295377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.295377] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 already deleted. [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.295377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.295377] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.337666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.337855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.337908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.338200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.338291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.338499] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.338596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.338652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.338817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.338889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.338972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c already deleted. [ 1460.339075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.400039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: SUCCESS [ 1460.400039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.400039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.400039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.400039] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.400039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.400039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.400415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.400415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.400415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.400415] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.593312] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1460.594531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.594531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.594531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.594531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.594531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.594531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.594837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.594837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.594837] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.616022] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.616022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.616022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.616022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.616022] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.616360] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.616360] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.616515] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.616655] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.616877] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.616987] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1460.618228] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1460.618382] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1460.618496] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.618611] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1460.619314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1460.639704] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1460.639704] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1460.639982] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1460.640136] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.640749] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-f4e90b11-2a07-4445-a753-40413d8cbdb1 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.640749] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.640964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.641139] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.641351] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e90b11-2a07-4445-a753-40413d8cbdb1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.813508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.813663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.815617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.815617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.815617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.815617] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 already deleted. [ 1460.815617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.906707] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.099811] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.144780] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.145117] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.145472] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.146710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.146710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.146710] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port f4e90b11-2a07-4445-a753-40413d8cbdb1 not found, creating... [ 1461.147256] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.148090] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.148788] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.149222] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.149482] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.149834] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.150015] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.150143] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.150368] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.150521] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.150656] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: f4e90b11-2a07-4445-a753-40413d8cbdb1 is going to be created. [ 1461.171652] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.171870] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.172025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.172294] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.172553] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.172884] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.373620] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2f2a6082-4df7-457f-a05a-8b0f9e9ba52c None None] Enqueued Resource ID: 0e5017da-d668-428d-a069-1338e7d25da2 with Priority: HIGHEST for action port [ 1461.374241] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e5017da-d668-428d-a069-1338e7d25da2 with Priority: HIGHEST for action port [ 1461.374480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e5017da-d668-428d-a069-1338e7d25da2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.374687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e5017da-d668-428d-a069-1338e7d25da2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.374687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e5017da-d668-428d-a069-1338e7d25da2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.374934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e5017da-d668-428d-a069-1338e7d25da2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.375265] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e5017da-d668-428d-a069-1338e7d25da2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.407926] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e70fb2ce-bed4-4221-be40-0a6c62d651e1: rpc.has_security_group_logging(os_id): False [ 1461.429361] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.429361] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.429361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.429361] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 is going to be created. [ 1461.493870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.493870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.493870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.493870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.496233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.508317] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: IN_PROGRESS for 2s [ 1461.603229] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.879626] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e5017da-d668-428d-a069-1338e7d25da2 [ 1461.879972] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.880248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.880349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.880561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.880696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.880804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e5017da-d668-428d-a069-1338e7d25da2 already deleted. [ 1461.880906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e5017da-d668-428d-a069-1338e7d25da2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.109395] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.109587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.109661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.109871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.109988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.110089] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be updated. [ 1462.140530] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.140964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.140964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.141286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.141737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.156415] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1462.322509] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-18799402-0c16-45ed-bcd1-a06655034a57 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1462.322700] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-18799402-0c16-45ed-bcd1-a06655034a57 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1462.322842] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-18799402-0c16-45ed-bcd1-a06655034a57 service nova] Enqueued Resource ID: f4e90b11-2a07-4445-a753-40413d8cbdb1 with Priority: HIGHEST for action port [ 1462.323094] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1462.323364] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1462.323364] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e90b11-2a07-4445-a753-40413d8cbdb1 with Priority: HIGHEST for action port [ 1462.323895] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.324042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.324118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.324610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.324610] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.325277] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.325418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.325483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.325638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.325786] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.325878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.326084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.326168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.326233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.326390] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.327042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4e90b11-2a07-4445-a753-40413d8cbdb1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.329502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.329502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.329502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.329502] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e90b11-2a07-4445-a753-40413d8cbdb1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.495058] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-646befb3-cfea-4424-b3b4-67dac2973109 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1462.495058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1462.495925] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.496229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.800037] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.800245] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.800380] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.800663] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.800954] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.801207] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.801207] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.801433] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.801588] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.801881] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1462.801986] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1462.805553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1462.805553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1462.805553] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1462.805553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1462.805553] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1462.823631] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1462.824701] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1462.824701] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1462.824701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.824701] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-00834943-e227-4506-a345-3694e7c9912a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.824701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.824701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.825160] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.825218] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00834943-e227-4506-a345-3694e7c9912a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.828949] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.829826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.829941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.830117] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4e90b11-2a07-4445-a753-40413d8cbdb1 with status ACTIVE [ 1462.830280] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.830397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.830463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.831594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.831594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.831594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.833338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.833338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.833338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.833338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.833338] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4e90b11-2a07-4445-a753-40413d8cbdb1 is going to be updated. [ 1462.867450] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.867450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.867450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.867737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.867737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.867904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4e90b11-2a07-4445-a753-40413d8cbdb1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.915908] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e021e7f9-0030-4a59-9899-28e69f3934d0 None None] Enqueued Resource ID: ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902 with Priority: HIGHEST for action port [ 1462.916194] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902 with Priority: HIGHEST for action port [ 1462.916766] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.916914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.917065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.917973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.917973] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.328166] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.331162] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.331425] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.331728] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.331887] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.332078] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 00834943-e227-4506-a345-3694e7c9912a not found, creating... [ 1463.332400] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.332609] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.332696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.332925] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.333063] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.333370] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.335606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.335606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.335606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.335606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.335606] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 00834943-e227-4506-a345-3694e7c9912a is going to be created. [ 1463.335606] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.357027] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.359017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.359017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.359017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.359017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.359017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.421205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902 [ 1463.421205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.421205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.421205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.421205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.421205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.421205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902 already deleted. [ 1463.421205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab9fbeab-6fd0-451c-9c74-7c5cf7d9f902" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.520331] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: SUCCESS [ 1463.525992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.839579] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.839579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.839579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.839579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.839579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.839978] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be created. [ 1463.865342] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.865514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.865561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.868701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.868701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.877075] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: UNINITIALIZED for 2s [ 1464.162261] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-ec3001aa-a1ba-4f36-bcbd-e5a337e18f5e service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1464.162533] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-ec3001aa-a1ba-4f36-bcbd-e5a337e18f5e service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1464.162700] env[71051]: INFO networking_nsxv3.common.synchronization [req-32f5c328-aceb-4a62-bd4e-a4847db09e86 req-ec3001aa-a1ba-4f36-bcbd-e5a337e18f5e service nova] Enqueued Resource ID: 00834943-e227-4506-a345-3694e7c9912a with Priority: HIGHEST for action port [ 1464.164253] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1464.164426] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1464.165174] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00834943-e227-4506-a345-3694e7c9912a with Priority: HIGHEST for action port [ 1464.165607] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.165689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.165919] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.166026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.166670] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-00834943-e227-4506-a345-3694e7c9912a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.166762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.166762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.167430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.167542] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00834943-e227-4506-a345-3694e7c9912a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.169359] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1464.169571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.169769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.170039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.170259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.170376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.170441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.170657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.170756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.170883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.171187] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.606459] env[71051]: INFO networking_nsxv3.common.synchronization [None req-6c733a1a-873d-455a-8271-5fb77cae9ca9 tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1464.608756] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1464.610567] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.610712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.610712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.611113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.611230] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.673546] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00834943-e227-4506-a345-3694e7c9912a with status ACTIVE [ 1464.673861] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.674018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.674084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.674326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.674438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.674628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.674728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.674805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.674963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.675050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.675241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.675355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.675417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.675559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.675646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.675733] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00834943-e227-4506-a345-3694e7c9912a is going to be updated. [ 1464.679873] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.680019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.680095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.680283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.680524] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.680699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.680790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.680975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.681844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.681844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.682980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.682980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.683182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.683336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.684118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.684258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.684366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.684570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.684684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.684817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.684936] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.708293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.708911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.709109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.709334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.709531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.709710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00834943-e227-4506-a345-3694e7c9912a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.754224] env[71051]: INFO networking_nsxv3.common.synchronization [None req-24de719e-ef49-4d9d-8cdf-f3f81b75363f tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1464.755021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1464.755360] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.755586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.131457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.131631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.131717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.131943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.132054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.132156] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a already deleted. [ 1465.132525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.132525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.132674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.132751] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.188396] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61b3ef5c-fe30-4fa8-843f-b800b5921066: rpc.has_security_group_logging(os_id): False [ 1465.205181] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.205341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.205394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.205615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.206333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.206333] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.206333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.206333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.206333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.206333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.206622] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.206622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.206763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.206803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.206841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.207254] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.207254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.207254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.207422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.207422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.207497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be updated. [ 1465.271054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.271292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.271292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.273033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.273033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.283469] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1465.474040] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fe324803-d471-4b25-b86d-728d9f59e1b1 None None] Enqueued Resource ID: bf1e892f-09be-4211-9f3b-0d168f8f5a3f with Priority: HIGHEST for action port [ 1465.474040] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1e892f-09be-4211-9f3b-0d168f8f5a3f with Priority: HIGHEST for action port [ 1465.474040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1e892f-09be-4211-9f3b-0d168f8f5a3f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.474040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1e892f-09be-4211-9f3b-0d168f8f5a3f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.474040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1e892f-09be-4211-9f3b-0d168f8f5a3f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.474040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1e892f-09be-4211-9f3b-0d168f8f5a3f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.474040] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1e892f-09be-4211-9f3b-0d168f8f5a3f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.688595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.688956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.688956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.689047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.689097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.689203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a already deleted. [ 1465.689303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.886986] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1465.887566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.887566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.887827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.887827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.887970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.888047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.888232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.888232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.889539] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.978203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf1e892f-09be-4211-9f3b-0d168f8f5a3f [ 1465.978203] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.978203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.978203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.978203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.978203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.978203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf1e892f-09be-4211-9f3b-0d168f8f5a3f already deleted. [ 1465.978203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1e892f-09be-4211-9f3b-0d168f8f5a3f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.390563] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.894265] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.299792] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1467.299792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.395622] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.396433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.396433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.396704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.396826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.396951] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1467.428275] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.428601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.428715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.429087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.429357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.440948] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1467.950300] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1467.950539] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1467.951127] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1467.951287] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1467.951614] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-da46ec09-3f12-420c-a1a7-ce086e42016a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.951764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.951856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.953317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.953795] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.953959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.954046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.954274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.954687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.955207] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.957242] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.957242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.957242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.957242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.957242] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.957574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.957574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.957692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.957786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.957881] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.060899] env[71051]: INFO networking_nsxv3.common.synchronization [req-074da11a-8831-48f4-b1fb-bf52ab997add req-152c2f74-2228-44e1-aa24-c57c7e33397d tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1468.061643] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1468.061987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.062198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.062371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.062796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.063043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.063285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.063458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.063696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.067024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.067024] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.072153] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1468.072415] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1468.072645] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_rules [ 1468.072825] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1468.073085] env[71051]: INFO networking_nsxv3.common.synchronization [req-d13c9b3b-4faa-498a-b141-34d9fa4ed3d9 req-93bcd195-1ff4-4c70-af32-3e64939d02a7 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1468.073914] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1468.073914] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_rules [ 1468.073914] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1468.074058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1468.074170] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1468.074850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.074926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.074995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.075210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.075291] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.076300] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da46ec09-3f12-420c-a1a7-ce086e42016a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.076442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.076551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.076807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.076864] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.080385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bf6c714-254d-49f5-be2c-a97817639fde taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.080385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.080385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.080385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.080385] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf6c714-254d-49f5-be2c-a97817639fde',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.080385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.080385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.080385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-da46ec09-3f12-420c-a1a7-ce086e42016a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.080385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.441690] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-814 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.442190] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.442575] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.442997] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.443767] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.443767] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.443767] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.443942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.444166] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.444331] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1468.444442] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1468.444553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1468.444678] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1468.444789] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1468.444895] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1468.445066] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1468.459422] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.460844] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.465891] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1468.466091] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1468.466239] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1468.466414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.466729] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-929a0394-fef6-41de-ae2c-746cc61372c3 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.466910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.467043] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.467355] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.467497] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929a0394-fef6-41de-ae2c-746cc61372c3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.552032] env[71051]: INFO networking_nsxv3.common.synchronization [req-cee345e2-11e7-4b90-af16-4fc9d94ddbba req-6a06b520-e305-413e-b10f-a67aeb7e302e tempest-ServerTagsTestJSON-128364070 tempest-ServerTagsTestJSON-128364070-project-member] Enqueued Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1468.552687] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGHEST for action security_group_members [ 1468.553115] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.553314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.553420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.553710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.553911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.555255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.555255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.555255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.555255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.555255] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.566973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.567147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.567222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.567436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.567551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.567750] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.567848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.567911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.568088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.568366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.568366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b already deleted. [ 1468.568366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.580217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-da46ec09-3f12-420c-a1a7-ce086e42016a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.580341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.580781] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.580781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.583452] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bf6c714-254d-49f5-be2c-a97817639fde with status ACTIVE [ 1468.583452] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.583452] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.583452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.583838] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.583927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.583976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.584145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.584254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.584374] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bf6c714-254d-49f5-be2c-a97817639fde is going to be updated. [ 1468.610812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.611697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.611886] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.612968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.612968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.612968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.955058] env[71051]: INFO networking_nsxv3.common.synchronization [req-4483cdac-da6e-48cd-919b-af9236e1050f req-36d61472-6bbc-4fe9-9e7a-9e6931b7d392 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1468.955058] env[71051]: INFO networking_nsxv3.common.synchronization [req-4483cdac-da6e-48cd-919b-af9236e1050f req-36d61472-6bbc-4fe9-9e7a-9e6931b7d392 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1468.955058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da46ec09-3f12-420c-a1a7-ce086e42016a with Priority: HIGHEST for action security_group_members [ 1468.955058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1468.955058] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-da46ec09-3f12-420c-a1a7-ce086e42016a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.955058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.955058] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.955058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.962459] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.968919] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.973039] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.973039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.973039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.973039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.973039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.973039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 929a0394-fef6-41de-ae2c-746cc61372c3 not found, creating... [ 1468.973039] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.973039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.973626] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.973626] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.973626] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.974066] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.974291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.974446] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.974722] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.974871] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.975100] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 929a0394-fef6-41de-ae2c-746cc61372c3 is going to be created. [ 1468.995242] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.995480] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.995641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.995948] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.996235] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.996643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.027416] env[71051]: INFO networking_nsxv3.common.synchronization [req-4483cdac-da6e-48cd-919b-af9236e1050f req-36d61472-6bbc-4fe9-9e7a-9e6931b7d392 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1469.029021] env[71051]: INFO networking_nsxv3.common.synchronization [req-4483cdac-da6e-48cd-919b-af9236e1050f req-36d61472-6bbc-4fe9-9e7a-9e6931b7d392 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1469.029021] env[71051]: INFO networking_nsxv3.common.synchronization [req-4483cdac-da6e-48cd-919b-af9236e1050f req-36d61472-6bbc-4fe9-9e7a-9e6931b7d392 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1469.029021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_rules [ 1469.029021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1469.029640] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf6c714-254d-49f5-be2c-a97817639fde with Priority: HIGHEST for action port [ 1469.029640] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.029640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.029765] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.029913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.030166] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bf6c714-254d-49f5-be2c-a97817639fde taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.030294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.030363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.030629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.030746] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf6c714-254d-49f5-be2c-a97817639fde',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.057422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.060382] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.060382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.060382] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 is going to be updated. [ 1469.084506] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.084647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.084716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.085048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.085111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.094093] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: IN_PROGRESS for 2s [ 1469.450671] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1469.450826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.450910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.451197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.452410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.452410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.452410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.452410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.452410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.452410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.452410] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.452906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.453122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.453324] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.453944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.454064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.454244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.454371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.454489] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.465641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.465641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.465641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.465641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.465641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.465641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a is going to be created. [ 1469.478085] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.478230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.478278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.478454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.478882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.478998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1469.487141] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.487282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.487355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.487564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.487729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.496198] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da46ec09-3f12-420c-a1a7-ce086e42016a in Status: UNINITIALIZED for 2s [ 1469.507990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.508150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.508222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.508433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.508572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.515453] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1469.536199] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bf6c714-254d-49f5-be2c-a97817639fde with status ACTIVE [ 1469.536199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.536199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.536199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.536199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.536199] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bf6c714-254d-49f5-be2c-a97817639fde is going to be updated. [ 1469.566748] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.566916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.566990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.567229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.567365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.567533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bf6c714-254d-49f5-be2c-a97817639fde" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.744270] env[71051]: INFO networking_nsxv3.common.synchronization [req-074da11a-8831-48f4-b1fb-bf52ab997add req-30591502-ed19-452e-a063-ffe6ccbc85ca service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1469.744401] env[71051]: INFO networking_nsxv3.common.synchronization [req-074da11a-8831-48f4-b1fb-bf52ab997add req-30591502-ed19-452e-a063-ffe6ccbc85ca service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1469.744514] env[71051]: INFO networking_nsxv3.common.synchronization [req-074da11a-8831-48f4-b1fb-bf52ab997add req-30591502-ed19-452e-a063-ffe6ccbc85ca service nova] Enqueued Resource ID: 929a0394-fef6-41de-ae2c-746cc61372c3 with Priority: HIGHEST for action port [ 1469.745131] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1469.745311] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1469.745425] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 929a0394-fef6-41de-ae2c-746cc61372c3 with Priority: HIGHEST for action port [ 1469.745715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.745842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.745906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.746213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.746292] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.747159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.747289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.747361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.747542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.747694] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.747789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.747888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.747999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.748114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.748205] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.748984] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-929a0394-fef6-41de-ae2c-746cc61372c3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.749168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.749238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.749546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.749591] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929a0394-fef6-41de-ae2c-746cc61372c3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.957150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.957150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.957730] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.251833] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.252038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.258554] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.260258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 929a0394-fef6-41de-ae2c-746cc61372c3 with status ACTIVE [ 1470.260438] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.260577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.260646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.260865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.260960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.261164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.261266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.261327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.261505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.261581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.261760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.261856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.261931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.262078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.262157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.262242] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 929a0394-fef6-41de-ae2c-746cc61372c3 is going to be updated. [ 1470.286178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.286318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.286385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.286592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.286733] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.286890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-929a0394-fef6-41de-ae2c-746cc61372c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.460554] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.759308] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.962694] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.963056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.963056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.963254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.963345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.963450] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1470.989082] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.989268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.989340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.989597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.989732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.998203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1471.103472] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 in Status: SUCCESS [ 1471.103657] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 deletion is rescheduled due to dependency. [ 1471.103778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.262173] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.262371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.262469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.262727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.262847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.262954] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be created. [ 1471.292422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.292422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.292422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.292649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.292705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.303040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: UNINITIALIZED for 2s [ 1471.507283] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da46ec09-3f12-420c-a1a7-ce086e42016a in Status: SUCCESS [ 1471.507653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.507972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.508355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.508681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.509806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.509945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.510270] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.510442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.510629] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.525505] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1471.525903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.526210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.526593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.526926] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.527159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.527279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.527576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.527746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.527927] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.018024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.018419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.018419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.020303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.020303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.020303] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a is going to be deleted. [ 1472.031507] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.085823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.086861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.086861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.086861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.086861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.086861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.087038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.087246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.087451] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.087575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.087646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.087822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.087908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.088019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.534556] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.592089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.592308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.592452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.592721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.592824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.593109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.593264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.593374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.593558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.593647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.593755] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a already deleted. [ 1472.593835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.593966] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.595166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.598138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.598273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.598387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.598452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.598628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.598721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.598820] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.013025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.013025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.013025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.013518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.013644] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.013908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.014112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.014436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.014761] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.015444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.015636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.015932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.016115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.016284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.016532] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.036758] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.037084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.037335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.037538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.037733] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.037790] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1473.069412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.069578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.069688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.069939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.070133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.078750] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1473.100530] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da46ec09-3f12-420c-a1a7-ce086e42016a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.103015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.103015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.103015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.103337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.103337] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a already deleted. [ 1473.103337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.315491] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1473.315865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.316092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.316337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.316533] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.316654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.316714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.316890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.316973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.317076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.317168] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.521242] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764cf243-3a8f-4abc-8bb0-1036c78cc82c: rpc.has_security_group_logging(os_id): False [ 1473.542059] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.542239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.542744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.542744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.542827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.543063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.543859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.543859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.543859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.543859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.544052] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.544052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.544138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.544373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.544373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.544564] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.544683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.544758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.544952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.545056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.545163] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be created. [ 1473.605217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.605217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.605217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.605217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.605217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.606341] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da46ec09-3f12-420c-a1a7-ce086e42016a: rpc.has_security_group_logging(os_id): False [ 1473.615421] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1473.638926] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.639238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.639238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.639454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.639571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.639812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.639930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.642797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.642797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.642797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.642797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a is going to be created. [ 1473.663167] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a], does not exist path=[/infra/domains/default/groups/da46ec09-3f12-420c-a1a7-ce086e42016a]."\n}' [ 1473.663322] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a [ 1473.664119] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1473.692862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.693068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.693140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.693516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.697439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.697439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.697439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.697439] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da46ec09-3f12-420c-a1a7-ce086e42016a is going to be created. [ 1473.721017] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a], does not exist path=[/infra/domains/default/groups/da46ec09-3f12-420c-a1a7-ce086e42016a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a [ 1473.721017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da46ec09-3f12-420c-a1a7-ce086e42016a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.721017] env[71051]: Traceback (most recent call last): [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1473.721017] env[71051]: return func(*args, **kwargs) [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1473.721017] env[71051]: res.raise_for_status() [ 1473.721017] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1473.721017] env[71051]: raise HTTPError(http_error_msg, response=self) [ 1473.721017] env[71051]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a [ 1473.721017] env[71051]: During handling of the above exception, another exception occurred: [ 1473.721017] env[71051]: Traceback (most recent call last): [ 1473.721017] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1473.721017] env[71051]: listener.cb(fileno) [ 1473.721017] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1473.721017] env[71051]: result = function(*args, **kwargs) [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1473.721017] env[71051]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1473.721017] env[71051]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1473.721017] env[71051]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1473.721017] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1473.721017] env[71051]: res.raise_for_status() [ 1473.721017] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1473.721017] env[71051]: raise HTTPError(http_error_msg, response=self) [ 1473.721017] env[71051]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da46ec09-3f12-420c-a1a7-ce086e42016a [ 1473.721017] env[71051]: Removing descriptor: 5 [ 1473.819732] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.819968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.820073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.820331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.820538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.820664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.820742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.820947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.821112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.821230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.821391] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.821681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.821681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.821814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.822277] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.822409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.822493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.822776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.822839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.822966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.823051] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.325506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b: rpc.has_security_group_logging(os_id): False [ 1474.342537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.342685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.342744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.342968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.343074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.343299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.343403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.343468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.343633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.343725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.343888] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.343982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.344064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.344194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.344271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.344448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.344535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.344598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.344738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.344813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.344897] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be created. [ 1474.398679] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.398927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.398927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.399640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.399640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.413664] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1474.749622] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.749622] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=8 [ 1475.090886] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1475.091269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.091341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.091546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.091778] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.092032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.092032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.092176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.092261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.092349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.092451] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.094900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.095144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.096034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.096034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.096034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.096034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.096034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.096034] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.597963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.598272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.599537] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.627091] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1475.627183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.627700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.627914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.628019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.939280] env[71051]: INFO networking_nsxv3.common.synchronization [None req-07175a52-a5dd-402d-920f-0880442801dc None None] Enqueued Resource ID: c29315f4-1daa-49d0-a69b-efd8e3db0157 with Priority: HIGHEST for action port [ 1475.939748] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29315f4-1daa-49d0-a69b-efd8e3db0157 with Priority: HIGHEST for action port [ 1475.940065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c29315f4-1daa-49d0-a69b-efd8e3db0157 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.940178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c29315f4-1daa-49d0-a69b-efd8e3db0157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.940246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c29315f4-1daa-49d0-a69b-efd8e3db0157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.940494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c29315f4-1daa-49d0-a69b-efd8e3db0157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.940583] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c29315f4-1daa-49d0-a69b-efd8e3db0157',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.037248] env[71051]: INFO networking_nsxv3.common.synchronization [req-989b5b48-962f-4a35-ad6c-767e0bef1817 req-5070697b-fb09-4b08-b458-d78a7627a50d tempest-AttachInterfacesV270Test-1920595930 tempest-AttachInterfacesV270Test-1920595930-project-member] Enqueued Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1476.037776] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1476.038628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.038900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.039021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.039254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.039429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.039536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.039598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.039755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.039843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.039939] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.101850] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.130757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.130906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.130978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.131220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.131398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.131577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.131644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.131988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.132117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.132184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.132280] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.429753] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1476.429753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.446152] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c29315f4-1daa-49d0-a69b-efd8e3db0157 [ 1476.446152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.446152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.446152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.446152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.446152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.446152] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c29315f4-1daa-49d0-a69b-efd8e3db0157 already deleted. [ 1476.446152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c29315f4-1daa-49d0-a69b-efd8e3db0157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.542857] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.542857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.543097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.543154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.543250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.543480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.543594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.543661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.544387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.544481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.544577] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c already deleted. [ 1476.544665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.573833] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.574044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-205" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.574176] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-205" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.574511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-205" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.574856] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.575051] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.575225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.575462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.576021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.576021] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1476.576021] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1476.576131] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1476.576186] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1476.576971] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1476.577130] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1476.577333] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1476.595522] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1476.596496] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1476.596496] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1476.596496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-205" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.596496] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-700e45a1-6df4-4711-82ce-00828430943d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.596700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.596799] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.597207] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.597392] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('700e45a1-6df4-4711-82ce-00828430943d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.604760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.605067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.605067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.605165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.605236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.605330] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1476.630895] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.631042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.631083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.631417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.631486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.634345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.634468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.634525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.634712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.634863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.634962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.635045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.635195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.635281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.635367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.636013] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.636013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.636013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.636013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.636013] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.636013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.636227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.636227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.636276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.636476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.636476] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.639902] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1477.100626] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.101118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.101118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.101630] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.101810] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.101973] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 700e45a1-6df4-4711-82ce-00828430943d not found, creating... [ 1477.102280] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.102455] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.102593] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.102782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.102923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.104049] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.106503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.106503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.106503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.106503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.106503] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 700e45a1-6df4-4711-82ce-00828430943d is going to be created. [ 1477.132171] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.132507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.132720] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.133363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.133363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.134301] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.138622] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764cf243-3a8f-4abc-8bb0-1036c78cc82c: rpc.has_security_group_logging(os_id): False [ 1477.156899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.156899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.156899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.156899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.177914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.177914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.177914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.177914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.179912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.180180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.180383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1477.254321] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.254321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.254321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.254321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.254321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.272460] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1477.873488] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4c778889-afcd-45b2-88c2-8bb6b13fc75b None None] Enqueued Resource ID: f56532e8-a82c-41f2-be9f-154a960ba987 with Priority: HIGHEST for action port [ 1477.875192] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f56532e8-a82c-41f2-be9f-154a960ba987 with Priority: HIGHEST for action port [ 1477.875192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f56532e8-a82c-41f2-be9f-154a960ba987 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.875192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f56532e8-a82c-41f2-be9f-154a960ba987" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.875192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f56532e8-a82c-41f2-be9f-154a960ba987" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.875192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f56532e8-a82c-41f2-be9f-154a960ba987" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.875192] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f56532e8-a82c-41f2-be9f-154a960ba987',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.882300] env[71051]: INFO networking_nsxv3.common.synchronization [req-989b5b48-962f-4a35-ad6c-767e0bef1817 req-d1e6affc-dd80-4e28-8bc4-b8f10fe81429 service nova] Enqueued Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_rules [ 1477.882790] env[71051]: INFO networking_nsxv3.common.synchronization [req-989b5b48-962f-4a35-ad6c-767e0bef1817 req-d1e6affc-dd80-4e28-8bc4-b8f10fe81429 service nova] Enqueued Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1477.883016] env[71051]: INFO networking_nsxv3.common.synchronization [req-989b5b48-962f-4a35-ad6c-767e0bef1817 req-d1e6affc-dd80-4e28-8bc4-b8f10fe81429 service nova] Enqueued Resource ID: 700e45a1-6df4-4711-82ce-00828430943d with Priority: HIGHEST for action port [ 1477.883931] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_rules [ 1477.884138] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1477.884299] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700e45a1-6df4-4711-82ce-00828430943d with Priority: HIGHEST for action port [ 1477.884634] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.884947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.885471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.885471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.885554] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.886466] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.886591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.886669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.886845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.887015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.887116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.887180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.887337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.887428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.887522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.888730] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-700e45a1-6df4-4711-82ce-00828430943d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.891848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.891848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.891848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.891848] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('700e45a1-6df4-4711-82ce-00828430943d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.905222] env[71051]: INFO networking_nsxv3.common.synchronization [req-659accdd-f092-4dde-b52e-d1bfc1ae0fb3 req-01e50231-8eb4-4430-b289-4b40533d51d3 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1477.906064] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1477.906381] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.906511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.906588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.906775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.906929] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.908162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.908162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.908162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.908162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.908162] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.160166] env[71051]: INFO networking_nsxv3.common.synchronization [req-22072a40-1637-419f-a564-b8fccb349ccf req-e66187ce-1938-4dfa-bfca-260e7b2e5115 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1478.160752] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1478.161080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.161188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.377755] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f56532e8-a82c-41f2-be9f-154a960ba987 [ 1478.378011] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.378243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.378243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.379203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.379203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.379203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f56532e8-a82c-41f2-be9f-154a960ba987 already deleted. [ 1478.379203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f56532e8-a82c-41f2-be9f-154a960ba987" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.389186] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.392854] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.393048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.393231] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 700e45a1-6df4-4711-82ce-00828430943d with status ACTIVE [ 1478.393336] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.393442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.393506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.393921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.393921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.394045] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.394089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.394161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.394294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.394374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.394600] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.394738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.394795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.394901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.394965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.395203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 700e45a1-6df4-4711-82ce-00828430943d is going to be updated. [ 1478.411688] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.430743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.431716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.431716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.432747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.432747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.432747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-700e45a1-6df4-4711-82ce-00828430943d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.492222] env[71051]: INFO networking_nsxv3.common.synchronization [req-d781d03f-8a1e-4e40-adc2-f4110729f344 req-f7bf413b-e75a-4528-b117-c579a1f74181 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1478.492798] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1478.493104] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.493250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.493311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.493575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.493957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.493957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.493957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.494163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.494163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.494253] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.619051] env[71051]: INFO networking_nsxv3.common.synchronization [req-350ebfb2-3be0-4377-84fe-b8db260d963d req-ea40d4d2-74e1-4dc3-a8dc-e2f5563cb539 tempest-ServerRescueTestJSONUnderV235-2049762762 tempest-ServerRescueTestJSONUnderV235-2049762762-project-member] Enqueued Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1478.620191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 with Priority: HIGHEST for action security_group_members [ 1478.620191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.620336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.651192] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.651192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.651192] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.892821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.918251] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.996830] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.996987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.997078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.997291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.016208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.016427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.016585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.016664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.016868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.016954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.017060] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1479.039841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.042093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.042093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.042093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.042093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.047684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1479.154962] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.155164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.155275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.155623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.175181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.175429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.175553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.175619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.175813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.175899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.175988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1479.199338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.199510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.199572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.199750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.199910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.213679] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1479.284633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1479.284633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.396173] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.396173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.396173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.396173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.396173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.396173] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c is going to be created. [ 1479.419371] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.419371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.419371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.419371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.419371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.424192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.424192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.424320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.424479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.424567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.424668] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1479.426643] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: UNINITIALIZED for 2s [ 1479.447128] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.447376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.447460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.447700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.447855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.456714] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1479.685931] env[71051]: INFO networking_nsxv3.common.synchronization [req-cc133ff4-f885-426f-b89e-c5c4eb99989c req-0b889d64-8620-413d-a298-2fd6013adac5 tempest-ServerAddressesTestJSON-1446860525 tempest-ServerAddressesTestJSON-1446860525-project-member] Enqueued Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1479.686461] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1479.687214] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.687343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.687415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.687669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.687834] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.687935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.688000] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.688172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.688263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.688361] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.117016] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.117292] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-956" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.117395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-956" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.117753] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-956" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.118089] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.118275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.118397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.118644] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.118784] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.118989] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1480.119375] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1480.119572] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1480.119709] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1480.119882] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1480.120048] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1480.120239] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1480.138776] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1480.138776] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1480.138776] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1480.138776] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-956" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.139114] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-0327bac9-f1dc-4595-bc07-08f7f8c67e24 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.139188] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.139352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.139650] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.139794] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0327bac9-f1dc-4595-bc07-08f7f8c67e24',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.189940] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.190125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.190192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.190436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.190537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.190741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.190840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.190918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.191084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.191163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.191262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 already deleted. [ 1480.191348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.642746] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.643030] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.643164] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.643440] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.643583] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.643793] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 0327bac9-f1dc-4595-bc07-08f7f8c67e24 not found, creating... [ 1480.644092] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.644292] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.644395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.644591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.644806] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.644994] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.645190] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.645286] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.645503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.645638] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.645777] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 0327bac9-f1dc-4595-bc07-08f7f8c67e24 is going to be created. [ 1480.673424] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.673648] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.673772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.674050] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.674275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.674497] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.927256] env[71051]: INFO networking_nsxv3.common.synchronization [req-8d93cdf8-0fa9-4ea2-8eb4-ffe98ef5d095 req-38d2305c-4ef6-4e33-9658-7ef998dea24c tempest-ServersAdminNegativeTestJSON-889609971 tempest-ServersAdminNegativeTestJSON-889609971-project-member] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1480.927886] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1480.932170] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.932170] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.932170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.932170] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.058475] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1481.058475] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1481.058475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1481.224021] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 deletion is rescheduled due to dependency. [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.224021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f22ee43-f198-4147-acc9-db3dc0e103a2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.224021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.224021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.224913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.224913] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.226033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.227734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.227734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.227734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.227734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.227734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.227734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.227734] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.433876] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.436212] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: SUCCESS [ 1481.436423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.436584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.436921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.437015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.437104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.437188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.437338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.437423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.437514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.437621] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.464796] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1481.464995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.465393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.465610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.465793] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.465910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.465969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.466138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.466276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.466326] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.615506] env[71051]: INFO networking_nsxv3.common.synchronization [req-cc133ff4-f885-426f-b89e-c5c4eb99989c req-5d8ace2c-6465-478e-941b-19d017654c37 service nova] Enqueued Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_rules [ 1481.615506] env[71051]: INFO networking_nsxv3.common.synchronization [req-cc133ff4-f885-426f-b89e-c5c4eb99989c req-5d8ace2c-6465-478e-941b-19d017654c37 service nova] Enqueued Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1481.615506] env[71051]: INFO networking_nsxv3.common.synchronization [req-cc133ff4-f885-426f-b89e-c5c4eb99989c req-5d8ace2c-6465-478e-941b-19d017654c37 service nova] Enqueued Resource ID: 0327bac9-f1dc-4595-bc07-08f7f8c67e24 with Priority: HIGHEST for action port [ 1481.615713] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_rules [ 1481.615838] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1481.615938] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0327bac9-f1dc-4595-bc07-08f7f8c67e24 with Priority: HIGHEST for action port [ 1481.616494] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.616620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.616719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.616941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.617418] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.618950] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.619081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.619150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.619333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.619497] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.619594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.619656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.619804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.619889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.619990] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.624021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0327bac9-f1dc-4595-bc07-08f7f8c67e24 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.624021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.624021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.624021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.624021] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0327bac9-f1dc-4595-bc07-08f7f8c67e24',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.729956] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f22ee43-f198-4147-acc9-db3dc0e103a2: rpc.has_security_group_logging(os_id): False [ 1481.733366] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.735863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.735863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.735863] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1481.748021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.748021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.748021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.748021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.748559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.748559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.748559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.748559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.748559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.748559] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be updated. [ 1481.757973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.758286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.758443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.758680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.758897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.766184] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1481.812746] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.812746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.812746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.812746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.812746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.823962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: IN_PROGRESS for 2s [ 1481.939585] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.941491] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.941759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.941948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.942089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.942339] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.942391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.942445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.942646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.942746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.942894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.943027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.943144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.943262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.943369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.943536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.943642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.943707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.943883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.943969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.944088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.944181] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.969084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.969285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.969370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.969611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.969892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.970144] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.970275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.970419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.970531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.970665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.971100] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1481.995698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.995845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.995915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.996137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.996278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.005535] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1482.120090] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.120090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.121799] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.124205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0327bac9-f1dc-4595-bc07-08f7f8c67e24 with status ACTIVE [ 1482.124205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.124205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.124205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.124205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.124205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.124716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.124716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.124716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.124716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.124716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.124872] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.124872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.124945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.125190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.125190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.125286] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0327bac9-f1dc-4595-bc07-08f7f8c67e24 is going to be updated. [ 1482.144656] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.144810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.144810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.144987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.145133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.145368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0327bac9-f1dc-4595-bc07-08f7f8c67e24" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.441890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.442277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.442277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.442404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.442467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.442574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be updated. [ 1482.446326] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f55dfd0-8351-4e68-b5e1-565d69ffd85c: rpc.has_security_group_logging(os_id): False [ 1482.463147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.463385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.463385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.463571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.463688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.463969] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.464098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.464164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.464322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.464403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.464595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.464691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.464754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.464895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.464973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.465172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.465263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.465325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.465464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.465529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.465619] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c is going to be created. [ 1482.467402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.467599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.467599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.467763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.467918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.476102] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1482.522101] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.522101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.522101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.522101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.522101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.531198] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: IN_PROGRESS for 2s [ 1482.627822] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.132835] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.132835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.132835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.132835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.132835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.132835] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 is going to be created. [ 1483.153848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.153848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.153848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.153848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.153848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.161634] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: UNINITIALIZED for 2s [ 1483.776080] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1483.776326] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 deletion is rescheduled due to dependency. [ 1483.776393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.834682] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 in Status: SUCCESS [ 1483.834959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.835194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.835424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.835526] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f22ee43-f198-4147-acc9-db3dc0e103a2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.015576] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1484.015871] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c deletion is rescheduled due to dependency. [ 1484.015998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.355304] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.355445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.355540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.355759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.355857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.355955] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f22ee43-f198-4147-acc9-db3dc0e103a2 is going to be deleted. [ 1484.402742] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.402904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.402963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.403207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.403304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.403426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f22ee43-f198-4147-acc9-db3dc0e103a2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.485500] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1484.485741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.554703] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: SUCCESS [ 1484.554955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.171091] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: SUCCESS [ 1485.171343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.171513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.171731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.171937] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.172088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.172157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.172319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.172405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.172495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.172709] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.674903] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.675148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.675253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.675545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.675800] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.675932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.675996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.676195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.676307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.676387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.676550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.676649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.676710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.676872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.677092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.677261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.677261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.677357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.677399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.677491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.677589] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.182591] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c2fd4bb-40e7-467a-aac0-215f99a17824: rpc.has_security_group_logging(os_id): False [ 1486.199462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.199605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.199677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.199903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.200007] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.200205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.200308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.200375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.200537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.200617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.200808] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.200948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.200988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.201113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.201189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.201376] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.201474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.201549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.201720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.201799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.201888] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 is going to be created. [ 1486.253078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.253078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.253078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.253078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.253302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.262095] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: IN_PROGRESS for 2s [ 1486.616645] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.616789] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1487.618156] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0a4fea2-a401-459e-b11d-68f6aa24d395 req-51f67fc4-8f23-4bb1-b330-a50cb2e83c1c tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1487.618156] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1487.618156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.618156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.618156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.618156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.618156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.618156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.618843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.619207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.619428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.619791] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.046955] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.046955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.046955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.053047] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.053489] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.053816] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.053926] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.054266] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.054433] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.054688] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1488.054809] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1488.054936] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1488.055089] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1488.055242] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1488.055352] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1488.055533] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1488.084731] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1488.085017] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1488.085119] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1488.085312] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.085663] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-3e87654d-806a-43cd-b433-4cfda09487b2 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.085866] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.085991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.086374] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.086543] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e87654d-806a-43cd-b433-4cfda09487b2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.122052] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.122222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.122291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.122547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.122673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.122856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.123562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.123562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.123672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.123771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.124067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 already deleted. [ 1488.124181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.274493] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: SUCCESS [ 1488.274839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.592543] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.592543] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 3e87654d-806a-43cd-b433-4cfda09487b2 not found, creating... [ 1488.592543] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.592543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.593085] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.593085] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.593824] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.594242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.594503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.594768] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 3e87654d-806a-43cd-b433-4cfda09487b2 is going to be created. [ 1488.615158] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.615699] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.615950] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.616330] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.616661] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.617119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.302498] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e19dcfbd-baf7-455d-ad60-3e5e6eb9f8cf None None] Enqueued Resource ID: 9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c with Priority: HIGHEST for action port [ 1489.302869] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c with Priority: HIGHEST for action port [ 1489.303169] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.304575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.304575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.304575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.304575] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.365105] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0a4fea2-a401-459e-b11d-68f6aa24d395 req-014da5d6-44ed-4baa-b785-a813c713967f service nova] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1489.365332] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0a4fea2-a401-459e-b11d-68f6aa24d395 req-014da5d6-44ed-4baa-b785-a813c713967f service nova] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1489.365498] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0a4fea2-a401-459e-b11d-68f6aa24d395 req-014da5d6-44ed-4baa-b785-a813c713967f service nova] Enqueued Resource ID: 3e87654d-806a-43cd-b433-4cfda09487b2 with Priority: HIGHEST for action port [ 1489.365978] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_rules [ 1489.366147] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1489.366260] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e87654d-806a-43cd-b433-4cfda09487b2 with Priority: HIGHEST for action port [ 1489.366655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.366811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.366811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.366922] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.367297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.372698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.372820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.372891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.373104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.373265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.373362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.373437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.373607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.373671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.373988] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.374531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e87654d-806a-43cd-b433-4cfda09487b2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.374999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.374999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.374999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.374999] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e87654d-806a-43cd-b433-4cfda09487b2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.807435] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c [ 1489.807435] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.807435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.807623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.807786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.807827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.807915] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c already deleted. [ 1489.808556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c0a18c3-7934-4e3e-867d-ff7e6fd1a73c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.880760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.880760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.881419] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.884042] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e87654d-806a-43cd-b433-4cfda09487b2 with status ACTIVE [ 1489.884524] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.884524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.884524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.884676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.884720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.884902] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.885010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.885073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.885228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.885337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.885577] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.885729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.885808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.887013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.888068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.888068] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e87654d-806a-43cd-b433-4cfda09487b2 is going to be updated. [ 1489.910993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.911150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.911228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.911424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.911572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.911779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e87654d-806a-43cd-b433-4cfda09487b2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.391149] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.737381] env[71051]: INFO networking_nsxv3.common.synchronization [req-65a3323e-816c-4838-bb13-9b7ef956c549 req-3d974162-d369-48d5-826a-2908756c4b09 tempest-TenantUsagesTestJSON-873573376 tempest-TenantUsagesTestJSON-873573376-project-member] Enqueued Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1490.740133] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1490.740133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.740133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.740133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.741653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.897237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.897237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.897237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.897237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.897237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.897237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 is going to be created. [ 1490.920028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.920028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.920028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.920028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.920028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.929685] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: UNINITIALIZED for 2s [ 1491.250066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.251769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.251769] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2469f80-4eb1-4a87-9a72-0d981b145113 already deleted. [ 1491.251769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.269021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.269021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.269021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.269021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.269021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.269547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.269906] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.270357] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.270690] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.271146] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1491.271485] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1491.273379] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1491.273379] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1491.273379] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1491.273379] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1491.273379] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1491.294923] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1491.295339] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1491.295515] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1491.295704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.296221] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.296221] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.296376] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.296683] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.296998] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.795421] env[71051]: INFO networking_nsxv3.common.synchronization [None req-ad8d4b59-451e-4506-9962-e3f8b7491749 None None] Enqueued Resource ID: 23013f1e-1bc4-4e3e-9d59-6829177274a4 with Priority: HIGHEST for action port [ 1491.795713] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23013f1e-1bc4-4e3e-9d59-6829177274a4 with Priority: HIGHEST for action port [ 1491.796461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-23013f1e-1bc4-4e3e-9d59-6829177274a4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.796655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23013f1e-1bc4-4e3e-9d59-6829177274a4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.796748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23013f1e-1bc4-4e3e-9d59-6829177274a4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.797014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23013f1e-1bc4-4e3e-9d59-6829177274a4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.797110] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23013f1e-1bc4-4e3e-9d59-6829177274a4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.799088] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.799275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.799594] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.799893] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.800149] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.800702] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d not found, creating... [ 1491.801185] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.801376] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.801552] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.801915] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.802098] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.802403] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.802591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.802696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.802910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.803063] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.803209] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d is going to be created. [ 1491.822741] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.822971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.823112] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.823400] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.824057] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.824057] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.299261] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23013f1e-1bc4-4e3e-9d59-6829177274a4 [ 1492.299574] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.299686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.299722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.299930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.300037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.300139] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23013f1e-1bc4-4e3e-9d59-6829177274a4 already deleted. [ 1492.300226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23013f1e-1bc4-4e3e-9d59-6829177274a4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.710296] env[71051]: INFO networking_nsxv3.common.synchronization [req-65a3323e-816c-4838-bb13-9b7ef956c549 req-5aa7eb65-8b35-4517-970a-325eb6935ead service nova] Enqueued Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_rules [ 1492.710495] env[71051]: INFO networking_nsxv3.common.synchronization [req-65a3323e-816c-4838-bb13-9b7ef956c549 req-5aa7eb65-8b35-4517-970a-325eb6935ead service nova] Enqueued Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1492.710641] env[71051]: INFO networking_nsxv3.common.synchronization [req-65a3323e-816c-4838-bb13-9b7ef956c549 req-5aa7eb65-8b35-4517-970a-325eb6935ead service nova] Enqueued Resource ID: b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d with Priority: HIGHEST for action port [ 1492.711255] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_rules [ 1492.711334] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1492.711434] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d with Priority: HIGHEST for action port [ 1492.711775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.711895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.711966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.715790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.715892] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.716938] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.717134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.717280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.717527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.717761] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.717932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.718095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.718251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.718344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.718440] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.720417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.720417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.720417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.720417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.720417] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.940225] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: SUCCESS [ 1492.940523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.940803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.941088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.942148] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.942332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.942412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.942637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.942737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.942777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.942887] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.059921] env[71051]: INFO networking_nsxv3.common.synchronization [req-a535ded7-c21b-40ba-84a7-88537752cd46 req-e86788dd-1e52-483b-9d4c-354a27a76ac0 tempest-AttachInterfacesV270Test-1920595930 tempest-AttachInterfacesV270Test-1920595930-project-member] Enqueued Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1493.060182] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGHEST for action security_group_members [ 1493.060480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.060599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.063019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.063019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.063019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.222560] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.222682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.222885] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.225709] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d with status ACTIVE [ 1493.225709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.225709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.225709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.226033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.226033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.226033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.226318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.226318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.226542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.226542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.226712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.226766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.226866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.227147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.227147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.227147] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d is going to be updated. [ 1493.246141] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.246279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.246349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.246549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.246686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.246844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2ced6fe-2da8-410e-ad60-2eb3eb27ef9d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.448386] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.564331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.564545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.564624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.564867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.564984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.565217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.565404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.565490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.565764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.565764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.565869] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c is going to be updated. [ 1493.598495] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.598727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.598727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.598968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.599125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.610401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: IN_PROGRESS for 2s [ 1493.724596] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.951252] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f5aee31-afbb-467a-9d2a-71123fe133d1: rpc.has_security_group_logging(os_id): False [ 1493.968385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.968534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.968606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.968833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.968930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.969184] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.969298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.969449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.969527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.969621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.969713] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 is going to be created. [ 1494.027177] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.027324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.027398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.027622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.027800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.039101] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: IN_PROGRESS for 2s [ 1494.055927] env[71051]: INFO networking_nsxv3.common.synchronization [req-8051094c-84cd-4785-ad18-2ddce2f9d604 req-1632cd6f-ad2d-4564-a9c0-138678242e66 tempest-DeleteServersAdminTestJSON-2104320323 tempest-DeleteServersAdminTestJSON-2104320323-project-member] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1494.057411] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1494.057798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.057928] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.060019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.060019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.060019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.226896] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.227083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.227172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.227387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.227482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.227579] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2469f80-4eb1-4a87-9a72-0d981b145113 is going to be created. [ 1494.253976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.254147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.254211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.254421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.254590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.264466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: UNINITIALIZED for 2s [ 1494.354526] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.354723] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.354851] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.355175] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.355445] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.355693] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.355748] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.355949] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.356108] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.356361] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1494.356420] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1494.356596] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1494.356673] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1494.356783] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1494.357030] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1494.357633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1494.376174] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1494.376342] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1494.376482] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1494.376654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.376958] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-e9e2cabc-882d-467b-b443-a8391b791f1a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.377143] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.377263] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.377567] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.377923] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e2cabc-882d-467b-b443-a8391b791f1a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.563887] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.564073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.564149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.564363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.564457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.564663] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.564766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.564828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.564980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.565072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.565148] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 already deleted. [ 1494.565230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.665016] env[71051]: INFO networking_nsxv3.common.synchronization [req-26dbb233-e34b-4f35-8d19-3bdc60ddfa16 req-06e1b0f3-0da0-443f-b16f-6b17157e766a tempest-ServerAddressesTestJSON-1446860525 tempest-ServerAddressesTestJSON-1446860525-project-member] Enqueued Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1494.665498] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGHEST for action security_group_members [ 1494.665979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.666553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.666553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.666690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.666912] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.667061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.667151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.667391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.667535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.667693] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.880252] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.880489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.880617] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.880906] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.881092] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.881275] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port e9e2cabc-882d-467b-b443-a8391b791f1a not found, creating... [ 1494.881692] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.881882] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.882013] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.882276] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.882475] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.882783] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.882942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.883072] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.883331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.883495] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.883646] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: e9e2cabc-882d-467b-b443-a8391b791f1a is going to be created. [ 1494.904383] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.904601] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.905674] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.905674] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.905674] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.905674] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.171126] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.171414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.172386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.172386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.172386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.172527] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.172592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.172670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.172813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.172889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.172975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 is going to be updated. [ 1495.204636] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.204789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.204909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.205105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.205241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.222406] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: IN_PROGRESS for 2s [ 1495.626048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c in Status: SUCCESS [ 1495.626244] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c deletion is rescheduled due to dependency. [ 1495.626361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.664823] env[71051]: INFO networking_nsxv3.common.synchronization [req-8051094c-84cd-4785-ad18-2ddce2f9d604 req-25ecf691-41b6-43d5-b7f3-5dbaef06a7a7 service nova] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_rules [ 1495.664954] env[71051]: INFO networking_nsxv3.common.synchronization [req-8051094c-84cd-4785-ad18-2ddce2f9d604 req-25ecf691-41b6-43d5-b7f3-5dbaef06a7a7 service nova] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1495.665102] env[71051]: INFO networking_nsxv3.common.synchronization [req-8051094c-84cd-4785-ad18-2ddce2f9d604 req-25ecf691-41b6-43d5-b7f3-5dbaef06a7a7 service nova] Enqueued Resource ID: e9e2cabc-882d-467b-b443-a8391b791f1a with Priority: HIGHEST for action port [ 1495.665346] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_rules [ 1495.665474] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1495.665574] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e2cabc-882d-467b-b443-a8391b791f1a with Priority: HIGHEST for action port [ 1495.666124] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.666267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.666336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.666606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.666712] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.667557] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.667676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.667744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.667909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.668072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.668162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.668223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.668363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.668449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.668539] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.669241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e2cabc-882d-467b-b443-a8391b791f1a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.669348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.669436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.669589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.669687] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e2cabc-882d-467b-b443-a8391b791f1a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.019558] env[71051]: INFO networking_nsxv3.common.synchronization [req-3acce4d4-e29f-40b0-ab87-cc488a6d113b req-c04d1f20-50ff-43b8-9c7d-fa9af8858959 tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1496.020115] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1496.020480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.020612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.020612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.020862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.021098] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.021197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.021277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.021465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.021617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.021727] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.051541] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: SUCCESS [ 1496.051541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.171755] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.172101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.172101] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.172867] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9e2cabc-882d-467b-b443-a8391b791f1a with status ACTIVE [ 1496.173075] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.173205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.173274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.173474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.173566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.173734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.173828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.173912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.174048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.174129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.174305] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.174396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.174457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.174630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.174714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.174798] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9e2cabc-882d-467b-b443-a8391b791f1a is going to be updated. [ 1496.195569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.195717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.195785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.195996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.196141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.196301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e2cabc-882d-467b-b443-a8391b791f1a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.273686] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: SUCCESS [ 1496.273930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.274123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.274328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.274542] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.274673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.274736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.274912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.275009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.275110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.275202] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.525850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.526112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.526189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.526409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.526641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.526764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.526871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.526938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.527107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.527191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.527282] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1496.555482] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.555627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.555690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.556078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.556078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.567967] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1496.677908] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.777755] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.777992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.778085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.778317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.778488] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.778601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.778667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.778820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.778912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.778999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.779188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.779284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.779345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.779490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.779628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.779720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.779780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.779915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.779990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.780082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.780180] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.187113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.187113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.187113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.187113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.187113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.187113] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be created. [ 1497.203762] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.203762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.203762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.203762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.204066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.211989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: UNINITIALIZED for 2s [ 1497.230136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 in Status: SUCCESS [ 1497.230341] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 deletion is rescheduled due to dependency. [ 1497.230468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.283974] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2469f80-4eb1-4a87-9a72-0d981b145113: rpc.has_security_group_logging(os_id): False [ 1497.300074] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.300263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.300326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.300571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.300667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.300862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.300959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.301031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.301185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.301265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.301457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.301601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.301659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.301801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.301944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.302166] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.302268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.302327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.302485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.302564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.302659] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2469f80-4eb1-4a87-9a72-0d981b145113 is going to be created. [ 1497.365523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.365681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.365775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.365952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.366144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.379357] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: IN_PROGRESS for 2s [ 1498.582217] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1498.582217] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b deletion is rescheduled due to dependency. [ 1498.582217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.917307] env[71051]: INFO networking_nsxv3.common.synchronization [req-6f218b44-8bef-4160-ab0d-49037b8bcc89 req-794e201a-aaf4-4b6d-a36b-7f7d343ec0f8 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1498.917307] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1498.917307] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.917307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.917867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.918906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.919832] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.920107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.920276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.920536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.920722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.920906] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.223125] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1499.223125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.223125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.223125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.223357] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.223415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.223452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.223595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.223768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.223768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.223865] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.391555] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: SUCCESS [ 1499.391894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.424745] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.424996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.425329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.425679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.425855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.426142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.426489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.426489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.426703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.426703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.426837] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 already deleted. [ 1499.426948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.433709] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.434185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.434322] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.434658] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.434966] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.435268] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.435268] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.435577] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.435835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.436079] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1499.436197] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1499.436429] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1499.436692] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1499.436770] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1499.437030] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1499.437030] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1499.456760] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1499.457152] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1499.457152] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1499.458053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.458053] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-428790f0-c156-4246-a1d6-e7721036eaa3 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.458053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.458053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.458315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.460021] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428790f0-c156-4246-a1d6-e7721036eaa3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.714138] env[71051]: INFO networking_nsxv3.common.synchronization [None req-20603be3-97a6-41e0-8aba-23c41fb0d111 None None] Enqueued Resource ID: d0851c76-7ba7-4b5b-9681-79e1a2df739f with Priority: HIGHEST for action port [ 1499.714138] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0851c76-7ba7-4b5b-9681-79e1a2df739f with Priority: HIGHEST for action port [ 1499.714138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0851c76-7ba7-4b5b-9681-79e1a2df739f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.714138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0851c76-7ba7-4b5b-9681-79e1a2df739f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.714138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0851c76-7ba7-4b5b-9681-79e1a2df739f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.714138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0851c76-7ba7-4b5b-9681-79e1a2df739f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.714138] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0851c76-7ba7-4b5b-9681-79e1a2df739f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.727917] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.728195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.728195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.729607] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.729607] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.729607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.730098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.730098] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.730098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.730200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.730360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.730443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.730579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.730684] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.963649] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.964096] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.964096] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.964507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.964549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.965351] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 428790f0-c156-4246-a1d6-e7721036eaa3 not found, creating... [ 1499.965351] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.965351] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.965351] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.965544] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.965653] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.966065] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.966170] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.966275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.966486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.966626] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.966768] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 428790f0-c156-4246-a1d6-e7721036eaa3 is going to be created. [ 1499.985154] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.985956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.985956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.985956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.986089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.986333] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.216099] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0851c76-7ba7-4b5b-9681-79e1a2df739f [ 1500.216346] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.216486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.216553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.216773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.216885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.217042] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0851c76-7ba7-4b5b-9681-79e1a2df739f already deleted. [ 1500.217146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0851c76-7ba7-4b5b-9681-79e1a2df739f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.232628] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f2493d4-27de-4333-a7cd-5237d967e052: rpc.has_security_group_logging(os_id): False [ 1500.252186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.252373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.252422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.252638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.252738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.252960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.253075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.253132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.253360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.253360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.253541] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.253637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.253703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.253834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.253931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.254141] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.254240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.254301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.254440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.256563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.256563] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be created. [ 1500.322603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.322967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.323071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.324019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.324019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.334695] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1501.093425] env[71051]: INFO networking_nsxv3.common.synchronization [req-6f218b44-8bef-4160-ab0d-49037b8bcc89 req-512cf348-383d-4cd3-8a18-f2d08316ea2d service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1501.093649] env[71051]: INFO networking_nsxv3.common.synchronization [req-6f218b44-8bef-4160-ab0d-49037b8bcc89 req-512cf348-383d-4cd3-8a18-f2d08316ea2d service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1501.093750] env[71051]: INFO networking_nsxv3.common.synchronization [req-6f218b44-8bef-4160-ab0d-49037b8bcc89 req-512cf348-383d-4cd3-8a18-f2d08316ea2d service nova] Enqueued Resource ID: 428790f0-c156-4246-a1d6-e7721036eaa3 with Priority: HIGHEST for action port [ 1501.093987] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1501.094129] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1501.094226] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428790f0-c156-4246-a1d6-e7721036eaa3 with Priority: HIGHEST for action port [ 1501.099426] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.099628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.099711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.099923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.100019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.103958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.103958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.103958] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.103958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-428790f0-c156-4246-a1d6-e7721036eaa3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.103958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.105868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.105868] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428790f0-c156-4246-a1d6-e7721036eaa3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.608747] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.608747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.608747] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.609277] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 428790f0-c156-4246-a1d6-e7721036eaa3 with status ACTIVE [ 1501.609480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.609594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.609657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.609857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.609939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.610225] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.610225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.610348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.610404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.610477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.610648] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.610732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.610788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.610920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.610992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.611707] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 428790f0-c156-4246-a1d6-e7721036eaa3 is going to be updated. [ 1501.631097] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.631372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.631475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.631722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.631860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.632738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-428790f0-c156-4246-a1d6-e7721036eaa3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.113419] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.192021] env[71051]: INFO networking_nsxv3.common.synchronization [None req-9a10ad06-45e5-469b-a9b0-dd4c6ba56251 None None] Enqueued Resource ID: 531815b7-6cfe-4168-9156-c78e6aa3e6c6 with Priority: HIGHEST for action port [ 1502.192021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531815b7-6cfe-4168-9156-c78e6aa3e6c6 with Priority: HIGHEST for action port [ 1502.192021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-531815b7-6cfe-4168-9156-c78e6aa3e6c6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.192021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-531815b7-6cfe-4168-9156-c78e6aa3e6c6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.192021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-531815b7-6cfe-4168-9156-c78e6aa3e6c6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.193423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-531815b7-6cfe-4168-9156-c78e6aa3e6c6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.193675] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('531815b7-6cfe-4168-9156-c78e6aa3e6c6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.345674] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1502.345674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.615386] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.615615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.615615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.615775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.615863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.615968] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be created. [ 1502.638092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.638230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.638298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.638506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.638655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.647826] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: UNINITIALIZED for 2s [ 1502.696531] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 531815b7-6cfe-4168-9156-c78e6aa3e6c6 [ 1502.696843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.697054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.697148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.697617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.697781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.697899] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:531815b7-6cfe-4168-9156-c78e6aa3e6c6 already deleted. [ 1502.697985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-531815b7-6cfe-4168-9156-c78e6aa3e6c6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.868065] env[71051]: INFO networking_nsxv3.common.synchronization [req-eccc3d08-018b-4142-b241-ec835e25052b req-277398b7-a951-4e03-a58d-a5140241e674 tempest-FloatingIPsAssociationTestJSON-2072692805 tempest-FloatingIPsAssociationTestJSON-2072692805-project-member] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1503.868585] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1503.869295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.869295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.869455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.869690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.869878] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.869970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.870047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.870186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.870269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.870359] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.375401] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.382310] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.382511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.382641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.382913] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.383785] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.383785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.383785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.383785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.383785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.384596] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1504.384814] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1504.384945] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1504.385087] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1504.385213] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1504.385356] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1504.385520] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1504.403612] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1504.403818] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1504.404035] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1504.404259] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-531" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.404656] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-e04a2854-9bb4-473f-86ad-4b183d40d5c3 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.404868] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.405044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.405445] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.405625] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04a2854-9bb4-473f-86ad-4b183d40d5c3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.658685] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1504.658913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.659108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.659321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.659507] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.659615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.659677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.659828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.659910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.659999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.660105] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.710942] env[71051]: INFO networking_nsxv3.common.synchronization [req-a4fd5017-1460-44a8-b830-77deeac1230c req-90f5c1a3-74bc-4dd5-86ba-c0b751752d40 tempest-TenantUsagesTestJSON-873573376 tempest-TenantUsagesTestJSON-873573376-project-member] Enqueued Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1504.711236] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2469f80-4eb1-4a87-9a72-0d981b145113 with Priority: HIGHEST for action security_group_members [ 1504.711537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2469f80-4eb1-4a87-9a72-0d981b145113 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.711681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.711752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.711951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.714957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.715095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.715146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.715330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.715439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.715514] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2469f80-4eb1-4a87-9a72-0d981b145113',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.879956] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.907866] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.908116] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.908242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.908542] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.908692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.908841] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port e04a2854-9bb4-473f-86ad-4b183d40d5c3 not found, creating... [ 1504.909115] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.909273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.909390] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.909643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.909790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.910083] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.910240] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.910353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.910561] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.910694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.910832] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: e04a2854-9bb4-473f-86ad-4b183d40d5c3 is going to be created. [ 1504.930118] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.930360] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.930485] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.930755] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.930984] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.931247] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.162604] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.217421] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.220722] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.220722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.220722] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2469f80-4eb1-4a87-9a72-0d981b145113 is going to be updated. [ 1505.250852] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.251098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.251098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.251681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.251681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.260941] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: IN_PROGRESS for 2s [ 1505.383162] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.383397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.383397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.383611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.383696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.383796] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be updated. [ 1505.419220] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.419423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.419423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.419701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.419864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.428542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1505.669060] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 1505.692057] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.692057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.692057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.692273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.692364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.692646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.692751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.692861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.692974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.693095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.693249] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be created. [ 1505.738194] env[71051]: INFO networking_nsxv3.common.synchronization [req-89562f99-6ae4-4950-8893-4dbeaa40c702 req-5b5e0baa-e32f-44ef-a379-f34cff7cd780 tempest-DeleteServersAdminTestJSON-697367752 tempest-DeleteServersAdminTestJSON-697367752-project-admin] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1505.739673] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1505.740015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.740150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.740220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.740421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.740571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.740750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.740750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.740887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.740970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.741078] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.767379] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.767379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.767379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.767379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.767379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.782403] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1506.068288] env[71051]: INFO networking_nsxv3.common.synchronization [req-eccc3d08-018b-4142-b241-ec835e25052b req-c30ddd6e-1941-4ca9-9508-960160c5430e service nova] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_rules [ 1506.068563] env[71051]: INFO networking_nsxv3.common.synchronization [req-eccc3d08-018b-4142-b241-ec835e25052b req-c30ddd6e-1941-4ca9-9508-960160c5430e service nova] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1506.068603] env[71051]: INFO networking_nsxv3.common.synchronization [req-eccc3d08-018b-4142-b241-ec835e25052b req-c30ddd6e-1941-4ca9-9508-960160c5430e service nova] Enqueued Resource ID: e04a2854-9bb4-473f-86ad-4b183d40d5c3 with Priority: HIGHEST for action port [ 1506.069078] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_rules [ 1506.069203] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1506.069295] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04a2854-9bb4-473f-86ad-4b183d40d5c3 with Priority: HIGHEST for action port [ 1506.069553] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.069677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.069738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.069930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.070016] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.074132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.074132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.074132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04a2854-9bb4-473f-86ad-4b183d40d5c3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.074132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.074299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.074381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.074459] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04a2854-9bb4-473f-86ad-4b183d40d5c3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.160806] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b49c8a85-ee4a-441c-a04c-1d5118e40794 None None] Enqueued Resource ID: 133f1f89-87a2-4b3d-8a23-2001b9908ced with Priority: HIGHEST for action port [ 1506.161428] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 133f1f89-87a2-4b3d-8a23-2001b9908ced with Priority: HIGHEST for action port [ 1506.161892] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-133f1f89-87a2-4b3d-8a23-2001b9908ced taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.162048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-133f1f89-87a2-4b3d-8a23-2001b9908ced" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.162116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-133f1f89-87a2-4b3d-8a23-2001b9908ced" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.162464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-133f1f89-87a2-4b3d-8a23-2001b9908ced" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.162580] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('133f1f89-87a2-4b3d-8a23-2001b9908ced',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.244237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.244237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.244393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.244485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.244592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.244786] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.244889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.244950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.245130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.245209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.245295] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be updated. [ 1506.270387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.270528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.270596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.272406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.272406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.280381] env[71051]: INFO networking_nsxv3.common.synchronization [req-8782076a-de6a-4a11-88e2-0a652cb95c68 req-4849af27-8ad2-4834-a2e6-9330adf8068a tempest-ImagesOneServerTestJSON-1939875970 tempest-ImagesOneServerTestJSON-1939875970-project-member] Enqueued Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1506.280798] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1506.283990] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1506.283990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.283990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.283990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.283990] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.579112] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.579112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.579112] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e04a2854-9bb4-473f-86ad-4b183d40d5c3 with status ACTIVE [ 1506.579112] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.579460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.579460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.579460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.579705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.579849] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.579959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.580040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.580225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.580311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.580494] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.580589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.580648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.580800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.580874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.580956] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e04a2854-9bb4-473f-86ad-4b183d40d5c3 is going to be updated. [ 1506.604391] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.604574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.604635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.604813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.604950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.605133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04a2854-9bb4-473f-86ad-4b183d40d5c3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.634612] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.634813] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-640" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.634937] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-640" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.635526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-640" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.635593] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.635717] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.635837] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.636074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.636246] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.636452] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.636579] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1506.636699] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1506.636810] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1506.636933] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.637062] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1506.637281] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1506.665324] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 133f1f89-87a2-4b3d-8a23-2001b9908ced [ 1506.665547] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.665682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.665754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.666034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.666141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.666237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:133f1f89-87a2-4b3d-8a23-2001b9908ced already deleted. [ 1506.666320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-133f1f89-87a2-4b3d-8a23-2001b9908ced" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.674500] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1506.674500] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1506.674500] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1506.674500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-640" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.674500] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-5ced147d-5542-44e4-abd5-ec0f00ae90d4 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.674500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.674500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.674500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.674500] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ced147d-5542-44e4-abd5-ec0f00ae90d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.786517] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.786689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.786763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.787125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.787125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.787274] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.787363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.787423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.787575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.787650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.787737] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b already deleted. [ 1506.787818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.176634] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.177525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.177525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.177525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.177625] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.177936] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 5ced147d-5542-44e4-abd5-ec0f00ae90d4 not found, creating... [ 1507.178056] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.178881] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.178881] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.178881] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.178881] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.179037] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.183265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.183387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.183615] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.183746] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.183886] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 5ced147d-5542-44e4-abd5-ec0f00ae90d4 is going to be created. [ 1507.206175] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.206367] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.206494] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.206765] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.207098] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.207335] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.270349] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2469f80-4eb1-4a87-9a72-0d981b145113 in Status: SUCCESS [ 1507.270813] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2469f80-4eb1-4a87-9a72-0d981b145113 deletion is rescheduled due to dependency. [ 1507.270946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2469f80-4eb1-4a87-9a72-0d981b145113" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.440908] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1507.441165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.441350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.441585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.441804] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.441966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.442038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.442237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.442327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.442449] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.794178] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1507.794397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.807851] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a5a21d7c-df45-4290-bf56-52f44d2cb6e0 None None] Enqueued Resource ID: 1f8507b4-c707-4db6-ad10-c7b7a1925842 with Priority: HIGHEST for action port [ 1507.807851] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8507b4-c707-4db6-ad10-c7b7a1925842 with Priority: HIGHEST for action port [ 1507.807851] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f8507b4-c707-4db6-ad10-c7b7a1925842 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.807851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f8507b4-c707-4db6-ad10-c7b7a1925842" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.807851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f8507b4-c707-4db6-ad10-c7b7a1925842" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.807851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f8507b4-c707-4db6-ad10-c7b7a1925842" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.807851] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8507b4-c707-4db6-ad10-c7b7a1925842',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.917875] env[71051]: INFO networking_nsxv3.common.synchronization [req-8782076a-de6a-4a11-88e2-0a652cb95c68 req-539dac25-9d32-46bd-a458-72c791b4101d service nova] Enqueued Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_rules [ 1507.918114] env[71051]: INFO networking_nsxv3.common.synchronization [req-8782076a-de6a-4a11-88e2-0a652cb95c68 req-539dac25-9d32-46bd-a458-72c791b4101d service nova] Enqueued Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1507.918311] env[71051]: INFO networking_nsxv3.common.synchronization [req-8782076a-de6a-4a11-88e2-0a652cb95c68 req-539dac25-9d32-46bd-a458-72c791b4101d service nova] Enqueued Resource ID: 5ced147d-5542-44e4-abd5-ec0f00ae90d4 with Priority: HIGHEST for action port [ 1507.918950] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_rules [ 1507.919493] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1507.919640] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ced147d-5542-44e4-abd5-ec0f00ae90d4 with Priority: HIGHEST for action port [ 1507.919924] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.920150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.920150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.920727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.920829] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.922164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.922283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.922371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.922562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.922824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.922945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.923019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.923182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.923276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.923370] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.924179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ced147d-5542-44e4-abd5-ec0f00ae90d4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.924276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.924337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.924488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.924587] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ced147d-5542-44e4-abd5-ec0f00ae90d4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.944690] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.291184] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1508.291184] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 deletion is rescheduled due to dependency. [ 1508.291184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.313752] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f8507b4-c707-4db6-ad10-c7b7a1925842 [ 1508.313752] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.313752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.313752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.313752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.313752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.313752] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f8507b4-c707-4db6-ad10-c7b7a1925842 already deleted. [ 1508.313752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f8507b4-c707-4db6-ad10-c7b7a1925842" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.428154] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ced147d-5542-44e4-abd5-ec0f00ae90d4 with status ACTIVE [ 1508.428377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.428458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.428494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.428759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.429138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.429191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.429624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.429624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.429765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.429813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.430427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.430427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.430427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.430606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.430606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.430671] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ced147d-5542-44e4-abd5-ec0f00ae90d4 is going to be updated. [ 1508.436033] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.436033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.436033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.448175] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.463125] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.463254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.463291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.463503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.463827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.464010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ced147d-5542-44e4-abd5-ec0f00ae90d4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.936189] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.950343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.950535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.950595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.950782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.950875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.950980] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be updated. [ 1508.977054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.977248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.977286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.977480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.977692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.985320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1509.136441] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-90310b18-c5c3-48d0-b666-e14b28c3eac3 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.136983] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.137289] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.137410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.137475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.138591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.138591] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.138591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.140766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.140987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.141092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.141205] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.438893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.439179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.439179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.439360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.439454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.439567] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b is going to be created. [ 1509.462773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.465018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.465018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.465018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.465018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.471253] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-f81196e9-9996-457e-a070-8941846ccf67 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.471820] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.472133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.472237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.474601] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: UNINITIALIZED for 2s [ 1509.644157] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.644523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.644684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.644920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.645034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.645243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.645696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.645782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.645946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.646039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.646132] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b already deleted. [ 1509.646214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.646362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.646650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.646650] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.646770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.646817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.646961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.647064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.647168] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.769319] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-cffbf5d7-2e89-447f-9f14-81138541c391 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.769842] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1509.770847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.770847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.118401] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.118746] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.119017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.119532] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.119969] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.120279] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.120546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.120936] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.121351] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.121607] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1510.121834] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1510.122200] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1510.122428] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1510.122780] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1510.122903] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1510.123213] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1510.141804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1510.142121] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1510.142370] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1510.142661] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.143526] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4adfa70d-4108-4992-aa21-1e091e56388f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.143793] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.144271] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.144642] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.145183] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4adfa70d-4108-4992-aa21-1e091e56388f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.151434] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.151656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.151759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.152068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.152229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.152523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.152721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.152822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.153091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.153263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.153412] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b already deleted. [ 1510.153552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.153783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.154054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.154342] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.154451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.154560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.154786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.154921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.156036] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.649024] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.649024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.649024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.649415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.649415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.649415] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4adfa70d-4108-4992-aa21-1e091e56388f not found, creating... [ 1510.649718] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.649892] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.650015] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.650329] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.650535] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.651350] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.651609] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.651784] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.652017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.652173] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.652320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4adfa70d-4108-4992-aa21-1e091e56388f is going to be created. [ 1510.660109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.660252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.660347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.660548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.660639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.660840] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.660975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.661051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.661212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.661288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.661372] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b already deleted. [ 1510.661450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.671253] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.671448] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.671568] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.671870] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.672350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.672350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.995058] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1510.995324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.995492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.995796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.995939] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.996097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.996169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.996321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.996405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.996489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.996584] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.421776] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-5ceb3f6b-e85f-45da-8aaa-26c0527b6bbd service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1511.422025] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-5ceb3f6b-e85f-45da-8aaa-26c0527b6bbd service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1511.422237] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-5ceb3f6b-e85f-45da-8aaa-26c0527b6bbd service nova] Enqueued Resource ID: 4adfa70d-4108-4992-aa21-1e091e56388f with Priority: HIGHEST for action port [ 1511.422883] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1511.423641] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1511.423834] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4adfa70d-4108-4992-aa21-1e091e56388f with Priority: HIGHEST for action port [ 1511.424265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.424404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.424469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.424763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.424851] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.427092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.427929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.427929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.427929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.428607] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.428607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.428607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.428769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.429832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.429832] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.431700] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4adfa70d-4108-4992-aa21-1e091e56388f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.431700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.431700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.431917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.431917] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4adfa70d-4108-4992-aa21-1e091e56388f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.483511] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: SUCCESS [ 1511.483729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.484109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.484325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.484511] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.484626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.484686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.484835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.484918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.485026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.485142] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.500039] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.500227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.500267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.500508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.500692] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.500795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.500845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.500999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.501105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.501194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.501337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.501430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.501489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.501675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.501928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.502056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.502126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.502286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.502369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.502454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.502545] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.927346] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.927648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.934544] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.935511] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4adfa70d-4108-4992-aa21-1e091e56388f with status ACTIVE [ 1511.935720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.935890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.935925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.936130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.936265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.936477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.936612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.936701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.936823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.936909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.937533] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.937533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.937533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.937533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.937533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.937533] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4adfa70d-4108-4992-aa21-1e091e56388f is going to be updated. [ 1511.956288] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.956518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.956596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.956807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.956939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.957118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4adfa70d-4108-4992-aa21-1e091e56388f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.987601] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.987762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.987835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.988070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.988241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.988344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.988430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.988567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.988648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.988747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.988881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.988971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.989045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.989262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.989401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.989500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.989675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.989747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.989802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.989912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.989969] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.007674] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd3d690a-4535-4aec-bcff-77d18d84cfbe: rpc.has_security_group_logging(os_id): False [ 1512.025344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.025344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.025344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.025521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.044701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.044994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.045213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.045213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.045426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.045514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.045960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.045960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.045960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.046092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.046092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.046269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.046363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.046425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.046566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.046740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.046740] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be updated. [ 1512.125042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.125042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.125042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.125042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.125042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.138801] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1512.194724] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.195361] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.196031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.196031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.197183] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.197386] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.197514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.197797] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.198016] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.198213] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1512.198335] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1512.198444] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1512.198553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1512.198664] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1512.198772] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1512.198910] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1512.221043] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1512.221159] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1512.221257] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1512.221884] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.221884] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-113f97eb-53db-4295-8e1b-c2b243a68a07 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.222159] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.222284] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.222706] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.222982] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113f97eb-53db-4295-8e1b-c2b243a68a07',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.440104] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.491897] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 638b0340-fa12-4f4e-b327-be39d30aa06b: rpc.has_security_group_logging(os_id): False [ 1512.509753] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.509932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.510037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.510231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.510325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.510522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.510617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.510677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.510832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.510917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.511242] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.511345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.511397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.511538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.511608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.511855] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.511952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.512024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.512175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.512254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.512343] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b is going to be created. [ 1512.570399] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.570552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.570617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.570831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.571019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.581676] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: IN_PROGRESS for 2s [ 1512.726060] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.726414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.726592] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.727297] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.727297] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.727297] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 113f97eb-53db-4295-8e1b-c2b243a68a07 not found, creating... [ 1512.727618] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.727811] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.727970] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.728252] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.728427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.728750] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.728939] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.729574] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.729902] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.730089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.730294] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 113f97eb-53db-4295-8e1b-c2b243a68a07 is going to be created. [ 1512.753722] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.753964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.754136] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.754431] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.754688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.754942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.943132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.943454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.943454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.943618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.943752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.943893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be created. [ 1512.970521] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.970675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.970716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.970912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.971080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.979602] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: UNINITIALIZED for 2s [ 1513.453646] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-6b8615c8-fa92-4e04-af78-a756cd423c64 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1513.453740] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-6b8615c8-fa92-4e04-af78-a756cd423c64 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1513.453865] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-6b8615c8-fa92-4e04-af78-a756cd423c64 service nova] Enqueued Resource ID: 113f97eb-53db-4295-8e1b-c2b243a68a07 with Priority: HIGHEST for action port [ 1513.455531] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1513.455531] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1513.455531] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113f97eb-53db-4295-8e1b-c2b243a68a07 with Priority: HIGHEST for action port [ 1513.457774] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.457774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.457902] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.457945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.458138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-113f97eb-53db-4295-8e1b-c2b243a68a07 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.458246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.458310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.458500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.458580] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113f97eb-53db-4295-8e1b-c2b243a68a07',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.964047] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 113f97eb-53db-4295-8e1b-c2b243a68a07 with status ACTIVE [ 1513.964047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.964047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.964047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.964047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.964047] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 113f97eb-53db-4295-8e1b-c2b243a68a07 is going to be updated. [ 1513.981786] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.982141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.983076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.983489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.983835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.984236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113f97eb-53db-4295-8e1b-c2b243a68a07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.154281] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1514.154281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.236829] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.237196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.237421] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.237890] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.238474] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.238655] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.238811] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.239201] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.239458] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.240042] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1514.240042] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1514.240343] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1514.241023] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1514.241023] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1514.241023] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1514.241169] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1514.260727] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1514.260906] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1514.261064] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1514.261247] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-585" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.261566] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4b91169b-ff64-4b84-bfba-a897b2fc33ce taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.261749] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.261875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.262212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.262356] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b91169b-ff64-4b84-bfba-a897b2fc33ce',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.593916] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: SUCCESS [ 1514.594173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.769479] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.769961] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.770086] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.770395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.771250] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.771250] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4b91169b-ff64-4b84-bfba-a897b2fc33ce not found, creating... [ 1514.771250] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.771250] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.771813] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.771813] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.771813] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.772544] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.772738] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.772889] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.773125] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.773318] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.773407] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4b91169b-ff64-4b84-bfba-a897b2fc33ce is going to be created. [ 1514.791468] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.791715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.791860] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.792141] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.792366] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.792589] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.989570] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1514.989860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.990151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.990361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.990556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.990680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.990756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.990930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.991028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.991115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.991212] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.992307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.995777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.995777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.995777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.995777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.995777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.995777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.995777] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.495545] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.495992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.495992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.521773] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-28f23c57-2965-4fe2-967f-ea1cfb237f86 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1515.522128] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-28f23c57-2965-4fe2-967f-ea1cfb237f86 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1515.522361] env[71051]: INFO networking_nsxv3.common.synchronization [req-b358e530-fc1e-490f-8bd5-e2eb04330af1 req-28f23c57-2965-4fe2-967f-ea1cfb237f86 service nova] Enqueued Resource ID: 4b91169b-ff64-4b84-bfba-a897b2fc33ce with Priority: HIGHEST for action port [ 1515.523226] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1515.523444] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1515.523597] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b91169b-ff64-4b84-bfba-a897b2fc33ce with Priority: HIGHEST for action port [ 1515.524031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.524141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.525624] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.525779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.526087] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b91169b-ff64-4b84-bfba-a897b2fc33ce taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.526212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.526777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.526990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.527199] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b91169b-ff64-4b84-bfba-a897b2fc33ce',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.999700] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.029818] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b91169b-ff64-4b84-bfba-a897b2fc33ce with status ACTIVE [ 1516.030073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.030246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.030325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.030806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.030905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.031100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.031212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.031271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.031431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.031722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.031942] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.032069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.032136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.032334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.032467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.032467] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b91169b-ff64-4b84-bfba-a897b2fc33ce is going to be updated. [ 1516.056835] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.056976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.057057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.057258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.057391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.057553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b91169b-ff64-4b84-bfba-a897b2fc33ce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.502613] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.502775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.502915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.503197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.503241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.503317] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1516.531994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.532165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.532240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.532534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.532577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.540483] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1518.550546] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1518.550897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.550953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.551174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.551364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.551482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.551544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.551723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.551802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.551890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.552064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.552149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.552205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.552336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.553841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.553841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.553841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.553841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.553841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.553841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.553841] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.555027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.555027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.555027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.555267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.555267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.555360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.555407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.555724] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.057967] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.061021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b: rpc.has_security_group_logging(os_id): False [ 1519.083364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.083364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.083364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.083364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.083837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.083837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.083837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.084549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.084809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.085026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be created. [ 1519.146205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.146205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.146205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.146205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.146205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.156314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1519.562171] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.067587] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.067764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.067839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.068070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.068170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.068275] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1520.095262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.095431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.095491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.098469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.098657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.108764] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1520.362562] env[71051]: INFO networking_nsxv3.common.synchronization [req-ed654e0d-3a5b-4ee1-8dbe-26739312c8c5 req-60dcf439-72de-4a7d-90c4-9b6ac9396f9e tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1520.362562] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1520.362562] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.362977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.368344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.368344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.368344] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.863948] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.864472] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-366" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.864472] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-366" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.864824] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-366" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.865079] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.865307] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.865378] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.865564] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.865713] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.866093] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1520.866228] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1520.866348] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1520.866465] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1520.866573] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1520.866771] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1520.866855] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1520.868494] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.868647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.868718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.868976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.868976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.869211] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.869211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.869419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.869419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.869573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.869573] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 already deleted. [ 1520.869708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.896935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1520.897398] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1520.897398] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1520.897663] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-366" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.898043] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-8b44405a-b451-4f95-9b01-f45548608a87 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.898210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.898280] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.898572] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.898703] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b44405a-b451-4f95-9b01-f45548608a87',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.939431] env[71051]: INFO networking_nsxv3.common.synchronization [req-cafe694b-4472-41ee-a952-3ad53c37ca2f req-1b2a8f81-0f5a-4c16-8830-aad2ac314348 tempest-FloatingIPsAssociationTestJSON-2072692805 tempest-FloatingIPsAssociationTestJSON-2072692805-project-member] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1520.940042] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1520.940358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.940487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.942229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.942229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.942229] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.169671] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1521.169671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.169671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.169671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.169671] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.400957] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.401212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.401339] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.401624] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.401846] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.402311] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 8b44405a-b451-4f95-9b01-f45548608a87 not found, creating... [ 1521.402398] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.402476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.402644] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.402913] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.403087] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.403443] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.403555] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.403666] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.403877] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.404073] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.404229] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 8b44405a-b451-4f95-9b01-f45548608a87 is going to be created. [ 1521.425411] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.425648] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.425763] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.426118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.426353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.426577] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.444496] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.672297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.672425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.946860] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.118597] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1522.118714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.119775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.119775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.119775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.119982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.119982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.120241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.120390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.120553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.120701] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.157305] env[71051]: INFO networking_nsxv3.common.synchronization [req-ed654e0d-3a5b-4ee1-8dbe-26739312c8c5 req-a944b313-2788-4782-a5b1-629e72a1e625 service nova] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1522.157641] env[71051]: INFO networking_nsxv3.common.synchronization [req-ed654e0d-3a5b-4ee1-8dbe-26739312c8c5 req-a944b313-2788-4782-a5b1-629e72a1e625 service nova] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1522.157903] env[71051]: INFO networking_nsxv3.common.synchronization [req-ed654e0d-3a5b-4ee1-8dbe-26739312c8c5 req-a944b313-2788-4782-a5b1-629e72a1e625 service nova] Enqueued Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1522.158596] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1522.158815] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1522.158985] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1522.159414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.159596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.159732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.160050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.160191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.161720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.161923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.162624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.162916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.163197] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.163343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.163830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.163830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.163929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.164117] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.165569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b44405a-b451-4f95-9b01-f45548608a87 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.165762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.165812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.166066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.166212] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b44405a-b451-4f95-9b01-f45548608a87',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.449523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.449747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.449848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.450018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.450176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.450237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be updated. [ 1522.477220] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.477358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.477399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.477665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.477839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.486048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1522.625743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.626136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.626136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.626244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.626417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.626526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.626850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.626850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.626850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.626997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.627096] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.627148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.627209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.627360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.627479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.627566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.627627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.628207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.628207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.628207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.628207] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.668193] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.669283] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.669416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.670138] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b44405a-b451-4f95-9b01-f45548608a87 with status ACTIVE [ 1522.670138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.670401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.670469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.670672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.670765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.670937] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.671159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.671248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.671405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.671476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.671653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.671754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.671811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.671913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.671986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.672083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b44405a-b451-4f95-9b01-f45548608a87 is going to be updated. [ 1522.692302] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.692457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.692519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.692736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.692874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.693047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.130246] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b: rpc.has_security_group_logging(os_id): False [ 1523.148135] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.148316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.148385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.148593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.148686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.148885] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.148985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.149059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.149208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.149287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.149477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.149575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.149721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.149899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.149977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.150179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.150276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.150334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.150471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.150546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.150633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1523.170886] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.206477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.206631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.206709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.206916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.207354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.218571] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1523.672538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.672713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.672713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.672915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.673028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.673139] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be created. [ 1523.697436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.697585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.697656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.697885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.698059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.706496] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: UNINITIALIZED for 2s [ 1524.497046] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1524.497384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.870787] env[71051]: INFO networking_nsxv3.common.synchronization [req-4492d1e6-0efb-45c0-9c1c-62c7ac917764 req-546f5f95-ecfb-442f-ad03-f8943131031d tempest-ServersAdminNegativeTestJSON-889609971 tempest-ServersAdminNegativeTestJSON-889609971-project-member] Enqueued Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1524.870787] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 with Priority: HIGHEST for action security_group_members [ 1524.871196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b3ef5c-fe30-4fa8-843f-b800b5921066 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.871543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.872121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.872425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.872715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.872958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.873115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.873507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.873862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.874181] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b3ef5c-fe30-4fa8-843f-b800b5921066',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.236138] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1525.236138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.236138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.236138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.236138] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.287310] env[71051]: INFO networking_nsxv3.common.synchronization [req-3a8435ab-a901-4e3d-9f70-6bc80af2323e req-7bd50ee6-ad28-4a02-b49d-d284892c9690 tempest-ServersTestManualDisk-284606207 tempest-ServersTestManualDisk-284606207-project-member] Enqueued Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1525.289589] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b with Priority: HIGHEST for action security_group_members [ 1525.289589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6235e93c-519f-43a7-8c8b-5c8b7d56575b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.289589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.289589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.289589] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6235e93c-519f-43a7-8c8b-5c8b7d56575b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.377506] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.377666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.377757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.377999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.398676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.399008] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.399097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.399168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.399377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.399493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.399611] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 is going to be updated. [ 1525.422362] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.422549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.422604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.423059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.423059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.430690] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: IN_PROGRESS for 2s [ 1525.718172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1525.718172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.718172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.718172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.718537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.718537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.718698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.718977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.718977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.719119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.719237] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.741525] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.741702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.741855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.742092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.742259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.742360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.742423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.742575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.742665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.742779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.742904] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.791599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.791812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.791881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.792167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.811085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.811981] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.811981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.811981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.811981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.811981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.811981] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b is going to be updated. [ 1525.834070] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.834237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.834309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.834522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.834658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.842516] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: IN_PROGRESS for 2s [ 1526.073265] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8a6e9050-cd0c-4a6b-bb77-9319eae56ffe tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: d33e8823-5603-485f-974a-fb1eb88732cf with Priority: HIGHEST for action security_group_rules [ 1526.073265] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33e8823-5603-485f-974a-fb1eb88732cf with Priority: HIGHEST for action security_group_rules [ 1526.075313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33e8823-5603-485f-974a-fb1eb88732cf taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.075602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.075779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.076130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.076432] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33e8823-5603-485f-974a-fb1eb88732cf',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.198610] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b3c76b5e-5633-4eb9-a6c7-00e06ea4108a tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: d33e8823-5603-485f-974a-fb1eb88732cf with Priority: HIGHEST for action security_group_rules [ 1526.202314] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33e8823-5603-485f-974a-fb1eb88732cf with Priority: HIGHEST for action security_group_rules [ 1526.202651] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33e8823-5603-485f-974a-fb1eb88732cf taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.202770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.224220] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.247991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.247991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.247991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.247991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.247991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.248550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.248550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.248550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.248550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.248550] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.611146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.611146] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33e8823-5603-485f-974a-fb1eb88732cf already deleted. [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.611146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.611434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.611434] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33e8823-5603-485f-974a-fb1eb88732cf',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.726935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b939b9-34f2-43da-9107-07642c640846: rpc.has_security_group_logging(os_id): False [ 1526.747288] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.747454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.747539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.747771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.747873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.748139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.748290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.748290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.748485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.748519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.748641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be created. [ 1526.751661] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b: rpc.has_security_group_logging(os_id): False [ 1526.767699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.767855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.767961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.768141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.768236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.768442] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.768585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.768662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.768857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.768943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.769156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.769254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.769314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.769457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.769534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.769724] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.769818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.769883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.770125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.770270] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.770314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1526.813646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.813773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.813811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.814037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.814221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.834150] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: IN_PROGRESS for 2s [ 1526.835064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.835198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.835267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.835471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.835631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.847711] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1527.134177] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.134177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.134177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.134177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.134177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.134177] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33e8823-5603-485f-974a-fb1eb88732cf already deleted. [ 1527.134177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33e8823-5603-485f-974a-fb1eb88732cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.440247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 in Status: SUCCESS [ 1527.440478] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b3ef5c-fe30-4fa8-843f-b800b5921066 deletion is rescheduled due to dependency. [ 1527.440624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b3ef5c-fe30-4fa8-843f-b800b5921066" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.528900] env[71051]: INFO networking_nsxv3.common.synchronization [req-eeff56c7-9b30-40d3-82fa-58a47dc922f1 req-983c4fc7-2b67-4132-8311-6fc61ca864a9 tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1527.529475] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1527.530097] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.530097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.530097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.530353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.530402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.530680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.530680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.530680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.530830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.530862] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.852415] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b in Status: SUCCESS [ 1527.853442] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6235e93c-519f-43a7-8c8b-5c8b7d56575b deletion is rescheduled due to dependency. [ 1527.853585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6235e93c-519f-43a7-8c8b-5c8b7d56575b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.862593] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.862816] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.862958] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.863322] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.863594] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.863751] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.864524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.864777] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.864932] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.865154] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1527.865270] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1527.865381] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1527.865842] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1527.865984] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1527.866144] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1527.866251] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1527.883272] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1527.883444] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1527.883582] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1527.883760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.884146] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-bbdbfb13-bd22-45e2-92dd-e95e99c76637 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.884345] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.884468] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.884778] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.884920] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbdbfb13-bd22-45e2-92dd-e95e99c76637',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.033283] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.033401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.033530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.034453] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.034453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.034879] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a already deleted. [ 1528.034879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.389249] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.389249] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.389249] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.389526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.389526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.389776] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port bbdbfb13-bd22-45e2-92dd-e95e99c76637 not found, creating... [ 1528.392021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.392021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.392021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.392532] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: bbdbfb13-bd22-45e2-92dd-e95e99c76637 is going to be created. [ 1528.411641] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.411990] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.412084] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.412327] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.412553] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.412789] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.497884] env[71051]: INFO networking_nsxv3.common.synchronization [req-d3600203-c67d-4f10-9bc0-0bf2891a3dc2 req-a0872fed-4ae8-495a-a3d7-0ded5cac0c8e tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.498486] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.498796] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.498935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.499079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.499216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.499530] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.500039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.500039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.500039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.500039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.500223] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.711162] env[71051]: INFO networking_nsxv3.common.synchronization [req-d3600203-c67d-4f10-9bc0-0bf2891a3dc2 req-376dbed3-0627-4b54-870c-54b31eaa0c77 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.711724] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.712325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.712496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.847763] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1528.847763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.859120] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1528.859763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.924633] env[71051]: INFO networking_nsxv3.common.synchronization [req-d3600203-c67d-4f10-9bc0-0bf2891a3dc2 req-4fde829a-c7e6-4b60-ac26-364de2140a7d tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.925173] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1528.925479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.925583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.002628] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.184209] env[71051]: INFO networking_nsxv3.common.synchronization [req-eeff56c7-9b30-40d3-82fa-58a47dc922f1 req-1413b418-af66-4085-bb14-b8f986366462 service nova] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1529.184402] env[71051]: INFO networking_nsxv3.common.synchronization [req-eeff56c7-9b30-40d3-82fa-58a47dc922f1 req-1413b418-af66-4085-bb14-b8f986366462 service nova] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1529.184540] env[71051]: INFO networking_nsxv3.common.synchronization [req-eeff56c7-9b30-40d3-82fa-58a47dc922f1 req-1413b418-af66-4085-bb14-b8f986366462 service nova] Enqueued Resource ID: bbdbfb13-bd22-45e2-92dd-e95e99c76637 with Priority: HIGHEST for action port [ 1529.184772] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_rules [ 1529.184907] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1529.184997] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdbfb13-bd22-45e2-92dd-e95e99c76637 with Priority: HIGHEST for action port [ 1529.185555] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.185680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.185749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.185951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.186129] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.186975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.187412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.187523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.187724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.187915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.188063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.188155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.188331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.188454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.188569] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.189423] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbdbfb13-bd22-45e2-92dd-e95e99c76637 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.189506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.189601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.189997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.189997] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbdbfb13-bd22-45e2-92dd-e95e99c76637',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.505955] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.692062] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.692273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.692388] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.693287] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbdbfb13-bd22-45e2-92dd-e95e99c76637 with status ACTIVE [ 1529.693566] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.693654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.693654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.693847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.693942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.694154] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.694255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.694319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.694492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.694807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.694807] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.694946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.694946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.695032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.695112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.695363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbdbfb13-bd22-45e2-92dd-e95e99c76637 is going to be updated. [ 1529.726235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.726437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.726437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.726642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.726774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.726933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbdbfb13-bd22-45e2-92dd-e95e99c76637" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.008877] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.009284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.009284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.009360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.009388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.009517] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1530.036612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.036703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.036737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.037084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.037231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.047077] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1530.198812] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.628460] env[71051]: INFO networking_nsxv3.common.synchronization [req-3303052e-1a5d-4d35-b5a0-1264afd8c4bf req-212a8f9d-c8cf-4b5f-8a85-77431d504861 tempest-ServersTestBootFromVolume-2134801246 tempest-ServersTestBootFromVolume-2134801246-project-member] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1530.628997] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1530.629325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.629461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.629522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.629765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.629940] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.630048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.630427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.630427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.630584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.630685] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.700929] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.700929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.701370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.701370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.701370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.701561] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a is going to be created. [ 1530.726564] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.726739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.726802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.727022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.727363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.738502] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: UNINITIALIZED for 2s [ 1531.133176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.133495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.133495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.133628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.133718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.134043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.134043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.134179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.134257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.134323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.134405] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 already deleted. [ 1531.134482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.208858] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-817 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.209117] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-817" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.209260] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-817" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.209643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-817" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.210043] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.210230] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.210361] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.210964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.210964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.210964] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1531.211169] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1531.211249] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1531.211369] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1531.211497] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1531.211604] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1531.211823] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1531.231109] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1531.231294] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1531.231433] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1531.231643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-817" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.232104] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-cedc6027-8d7b-4f0a-a559-1c1200047ed8 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.232309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.232431] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.232880] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.232963] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cedc6027-8d7b-4f0a-a559-1c1200047ed8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.735095] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.735323] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.735463] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.735761] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.735985] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.736180] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port cedc6027-8d7b-4f0a-a559-1c1200047ed8 not found, creating... [ 1531.736469] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.736647] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.736769] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.737022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.737168] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.737479] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.737658] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.737796] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.738044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.738203] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.738353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: cedc6027-8d7b-4f0a-a559-1c1200047ed8 is going to be created. [ 1531.758733] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.758962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.759131] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.759430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.759694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.760034] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.055988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1532.056228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.056384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.056589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.056769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.056883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.056949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.057113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.057198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.057347] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.436057] env[71051]: INFO networking_nsxv3.common.synchronization [req-3303052e-1a5d-4d35-b5a0-1264afd8c4bf req-6606fdd7-2571-42cb-a12e-b7baec1bcf64 service nova] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1532.436300] env[71051]: INFO networking_nsxv3.common.synchronization [req-3303052e-1a5d-4d35-b5a0-1264afd8c4bf req-6606fdd7-2571-42cb-a12e-b7baec1bcf64 service nova] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1532.436381] env[71051]: INFO networking_nsxv3.common.synchronization [req-3303052e-1a5d-4d35-b5a0-1264afd8c4bf req-6606fdd7-2571-42cb-a12e-b7baec1bcf64 service nova] Enqueued Resource ID: cedc6027-8d7b-4f0a-a559-1c1200047ed8 with Priority: HIGHEST for action port [ 1532.437367] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_rules [ 1532.437367] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1532.437367] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cedc6027-8d7b-4f0a-a559-1c1200047ed8 with Priority: HIGHEST for action port [ 1532.437367] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.437521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.437521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.437682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.437760] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.441461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.441461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.441461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.441461] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.442776] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-cedc6027-8d7b-4f0a-a559-1c1200047ed8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.442850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.443039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.443215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.443294] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cedc6027-8d7b-4f0a-a559-1c1200047ed8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.560293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.560450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.560521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.560737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.560835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.561042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.561146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.561208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.561364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.561444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.561535] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1532.585135] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.585135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.585135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.585135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.585135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.592885] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1532.752872] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: SUCCESS [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.752872] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.752872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.752872] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.947394] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.947394] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cedc6027-8d7b-4f0a-a559-1c1200047ed8 with status ACTIVE [ 1532.947394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.947394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.947394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.947394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.948063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.948063] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cedc6027-8d7b-4f0a-a559-1c1200047ed8 is going to be updated. [ 1532.951912] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.952046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.969943] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.970107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.970180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.970382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.970523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.970678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cedc6027-8d7b-4f0a-a559-1c1200047ed8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.255452] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.452901] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.761513] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d25bc2bf-35b9-46ff-8995-4834b28ed22a: rpc.has_security_group_logging(os_id): False [ 1533.778124] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.778325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.778399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.778614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.778709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.778956] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.779093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.779159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.779313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.779393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.779480] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a is going to be created. [ 1533.839536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.839671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.839744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.839956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.840153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.854211] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: IN_PROGRESS for 2s [ 1533.958719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.958719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.958719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.958719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.958719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.958719] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 is going to be created. [ 1534.003023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.003023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.003023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.003023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.003023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.014280] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: UNINITIALIZED for 2s [ 1534.604530] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1534.604796] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b deletion is rescheduled due to dependency. [ 1534.604847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.605016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.605279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.605469] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.605586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.605650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.605802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.605888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.605985] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.112727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.112932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.113069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.113307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.113405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.113641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.113779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.113855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.114064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.114178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.114279] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1535.136763] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.137027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.137027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.137314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.137621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.145336] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1535.867506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: SUCCESS [ 1535.868446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.024172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: SUCCESS [ 1536.024405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.024626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.024899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.025214] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.025280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.025312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.025457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.025544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.025668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.025718] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.278455] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b7119b00-8406-4ae1-9d8e-689c5d6e2ca3 tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: a76ef35e-ea28-4341-b036-dbb454967f52 with Priority: HIGHEST for action security_group_rules [ 1536.278455] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76ef35e-ea28-4341-b036-dbb454967f52 with Priority: HIGHEST for action security_group_rules [ 1536.278455] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a76ef35e-ea28-4341-b036-dbb454967f52 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.278455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.278455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.278455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.278455] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a76ef35e-ea28-4341-b036-dbb454967f52',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.369760] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3d1e5bf3-c0b9-46c1-90ad-5abff79c7489 tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: a76ef35e-ea28-4341-b036-dbb454967f52 with Priority: HIGHEST for action security_group_rules [ 1536.369760] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76ef35e-ea28-4341-b036-dbb454967f52 with Priority: HIGHEST for action security_group_rules [ 1536.369760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a76ef35e-ea28-4341-b036-dbb454967f52 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.369760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.528273] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.802176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.802292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.802361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.802566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.802655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.802746] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a76ef35e-ea28-4341-b036-dbb454967f52 already deleted. [ 1536.802915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.803013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.803172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.803251] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a76ef35e-ea28-4341-b036-dbb454967f52',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.030670] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3eb910ff-24da-4a21-bff7-7efb598948f2: rpc.has_security_group_logging(os_id): False [ 1537.048297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.049468] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.049468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.049826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.049826] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 is going to be created. [ 1537.118122] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.118325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.118406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.118634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.118815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.131403] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: IN_PROGRESS for 2s [ 1537.173903] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1537.175048] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b deletion is rescheduled due to dependency. [ 1537.175048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.322384] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.322384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.322384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.322584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.323712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.323712] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a76ef35e-ea28-4341-b036-dbb454967f52 already deleted. [ 1537.323712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a76ef35e-ea28-4341-b036-dbb454967f52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.907301] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae1d15fd-7d2b-4539-9761-4ecc08ce8318 req-4ae8004a-28c2-4718-b60e-4198fb7ca62c tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1538.907846] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1538.908204] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.908319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.908319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.908515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.908841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.908841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.908841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.908999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.909190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.909327] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.147212] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: SUCCESS [ 1539.147480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.231702] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.231972] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.232121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.232426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.232701] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.232875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.232995] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.235554] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.235554] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.235720] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1539.235824] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1539.235934] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1539.236154] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1539.236517] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1539.236648] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1539.236790] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1539.254770] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1539.254933] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1539.257019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1539.257019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.257019] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-7260ff00-3617-4a39-9400-aa9eed0c382c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.257019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.257019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.257019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.257019] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7260ff00-3617-4a39-9400-aa9eed0c382c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.411994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.413099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.413099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.413099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.433879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.433879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.433879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.433879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.433879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.433879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.433879] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1539.455712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.458018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.458018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.458018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.458018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.467655] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1539.759469] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.759849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.763025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 7260ff00-3617-4a39-9400-aa9eed0c382c not found, creating... [ 1539.763025] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.763025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.763025] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.763418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.763418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.763418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.763503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.763722] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 7260ff00-3617-4a39-9400-aa9eed0c382c is going to be created. [ 1539.786672] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.786672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.786672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.786672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.786672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.786672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.485198] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae1d15fd-7d2b-4539-9761-4ecc08ce8318 req-28eabc30-63c5-4442-8a1b-5d19f7b3df81 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1540.485774] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae1d15fd-7d2b-4539-9761-4ecc08ce8318 req-28eabc30-63c5-4442-8a1b-5d19f7b3df81 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1540.492476] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae1d15fd-7d2b-4539-9761-4ecc08ce8318 req-28eabc30-63c5-4442-8a1b-5d19f7b3df81 service nova] Enqueued Resource ID: 7260ff00-3617-4a39-9400-aa9eed0c382c with Priority: HIGHEST for action port [ 1540.492476] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1540.492476] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1540.492476] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7260ff00-3617-4a39-9400-aa9eed0c382c with Priority: HIGHEST for action port [ 1540.492476] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.492476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.492476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.492476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.492476] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.492476] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.492476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.492476] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7260ff00-3617-4a39-9400-aa9eed0c382c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.497686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.497686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.497686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.497686] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7260ff00-3617-4a39-9400-aa9eed0c382c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.005222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.005222] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7260ff00-3617-4a39-9400-aa9eed0c382c with status ACTIVE [ 1541.005222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.005222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.005222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.005222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.006126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.006126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.006126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.006126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.006126] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7260ff00-3617-4a39-9400-aa9eed0c382c is going to be updated. [ 1541.023425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.023633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.023729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.024068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.024285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.024530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7260ff00-3617-4a39-9400-aa9eed0c382c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.477486] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1541.477686] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1541.477821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.477992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.478248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.479023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.479023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.479023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.479023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.479023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.479023] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.512867] env[71051]: INFO networking_nsxv3.common.synchronization [req-fe198757-4b2f-41a6-8e7c-c9160e4074e6 req-5e6950c5-6c06-45f0-9ad6-b75b97a9b4a3 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1541.513540] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1541.514856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.515046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.515141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.515368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.515559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.515806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.515895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.517670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.517779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.517882] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.982059] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.023460] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.023622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.023696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.023909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.024023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.024239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.024347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.024413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.024579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.024676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.024743] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1542.048235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.048235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.048235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.048235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.048235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.057492] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1542.066137] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.066137] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.066137] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.066137] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.066137] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.066137] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.066137] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.067604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.071031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.071031] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1542.071031] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1542.071031] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1542.071031] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1542.071031] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1542.071031] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1542.071031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1542.090545] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1542.090545] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1542.090670] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1542.091424] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.091424] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-1d258233-65de-4e7e-abca-b41ed4ccbf4a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.091424] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.091424] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.092211] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.092211] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d258233-65de-4e7e-abca-b41ed4ccbf4a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.485338] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.594478] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.594838] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.594838] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.595212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.595369] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.595529] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 1d258233-65de-4e7e-abca-b41ed4ccbf4a not found, creating... [ 1542.595794] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.595955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.596089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.596315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.596455] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.596824] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.600492] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.600705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.600965] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.601133] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.601286] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 1d258233-65de-4e7e-abca-b41ed4ccbf4a is going to be created. [ 1542.621729] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.622178] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.622458] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.622886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.623144] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.623385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.988633] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.988818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.988862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.989361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.989361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.989361] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1543.017478] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.017478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.017674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.017778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.018058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.025737] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1543.380246] env[71051]: INFO networking_nsxv3.common.synchronization [req-fe198757-4b2f-41a6-8e7c-c9160e4074e6 req-50942778-3355-4970-91e9-08c5a8175de1 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1543.380451] env[71051]: INFO networking_nsxv3.common.synchronization [req-fe198757-4b2f-41a6-8e7c-c9160e4074e6 req-50942778-3355-4970-91e9-08c5a8175de1 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1543.380590] env[71051]: INFO networking_nsxv3.common.synchronization [req-fe198757-4b2f-41a6-8e7c-c9160e4074e6 req-50942778-3355-4970-91e9-08c5a8175de1 service nova] Enqueued Resource ID: 1d258233-65de-4e7e-abca-b41ed4ccbf4a with Priority: HIGHEST for action port [ 1543.380819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1543.380951] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1543.381062] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d258233-65de-4e7e-abca-b41ed4ccbf4a with Priority: HIGHEST for action port [ 1543.381620] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.381745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.381920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.382109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.382146] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.383412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.383535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.383783] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d258233-65de-4e7e-abca-b41ed4ccbf4a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.383783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.383897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.384056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.384185] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d258233-65de-4e7e-abca-b41ed4ccbf4a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.886314] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.886741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.887349] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d258233-65de-4e7e-abca-b41ed4ccbf4a with status ACTIVE [ 1543.887646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.887778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.887851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.888073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.888509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.888509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.888509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.888509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.888790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.888790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.888892] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.888987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.889093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.889240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.889375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.889415] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d258233-65de-4e7e-abca-b41ed4ccbf4a is going to be updated. [ 1543.910139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.912875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.912875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.912875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.912875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.912875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d258233-65de-4e7e-abca-b41ed4ccbf4a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.066466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1544.066724] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1544.066805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.066919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.067153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.067331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.067476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.067548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.067654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.067736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.067832] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.096123] env[71051]: INFO networking_nsxv3.common.synchronization [req-943de8d9-70ed-4061-a173-95d3bf204921 req-3436e2e1-c8a1-480a-ab61-134eb982973b tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1544.096641] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1544.096935] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.097070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.097139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.097390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.097548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.097646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.097709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.097859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.097946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.098056] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.471583] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.471845] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.472086] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.473681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.473681] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.473681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.473681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.473681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.474681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.474681] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1544.474681] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1544.474681] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1544.474681] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1544.474681] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1544.476053] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1544.476053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1544.493647] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1544.493841] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1544.493992] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1544.494204] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.494504] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.494680] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.494805] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.495150] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.495297] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.574860] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.600438] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.600579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.600651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.600871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.600971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.601232] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.601334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.601396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.601560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.601640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.601722] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 already deleted. [ 1544.601801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.001074] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.001074] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 not found, creating... [ 1545.001074] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.001074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.001969] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.001969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.001969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.002700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.003022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.003276] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 is going to be created. [ 1545.033875] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.033875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.033875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.033875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.033875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.033875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.037558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1545.037948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.038243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.038531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.038835] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.039093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.039553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.040806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.040806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.040806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.040806] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.075962] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.543398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.543398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.543649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.543755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.543889] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.543992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.544106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.544222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.544313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.544401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.544549] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.544862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.544862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.544862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.545026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.545189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.545410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.545628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.545723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.545831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.545988] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.577498] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.577650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.577712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.578011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.578119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.578220] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1545.605850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.606047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.606094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.606290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.606429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.614247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [req-943de8d9-70ed-4061-a173-95d3bf204921 req-d0d974ce-8990-45e2-8460-380a2f134383 service nova] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_rules [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [req-943de8d9-70ed-4061-a173-95d3bf204921 req-d0d974ce-8990-45e2-8460-380a2f134383 service nova] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [req-943de8d9-70ed-4061-a173-95d3bf204921 req-d0d974ce-8990-45e2-8460-380a2f134383 service nova] Enqueued Resource ID: ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 with Priority: HIGHEST for action port [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_rules [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1545.731301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 with Priority: HIGHEST for action port [ 1545.731301] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.731301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.731301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.731301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.731301] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.731790] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.731790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.731913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.732966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.732966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.732966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.732966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.732966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.732966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.732966] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.733751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.733858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.734156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.734156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.734156] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.050049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1546.073425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.073425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.073425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.073425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.074302] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.074302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.074302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.074302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.074302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.074302] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1546.130609] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.130771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.130817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.131973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.131973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.146468] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1546.239021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.239021] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.239021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 with status ACTIVE [ 1546.239021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.239021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.239021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.239785] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.239785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.239785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.239785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.239785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.240085] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6 is going to be updated. [ 1546.266413] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.266413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.266413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.266413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.266730] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.266730] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebe9a3c6-9cbb-4e43-8d3b-fa90912ef6b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.742480] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.245487] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.245798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.245798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.245931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.246038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.246137] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be created. [ 1547.268164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.268346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.268346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.268622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.268794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.279177] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: UNINITIALIZED for 2s [ 1547.623378] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1547.623716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.623884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.624211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.624365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.624503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.624618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.624818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.624960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.625066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.625164] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.127403] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.127586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.127664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.127848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.128318] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.128318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.128318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.128318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.128614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.128614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.128714] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.128714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.128834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.128922] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.129058] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.129160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.129215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.129343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.129424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.129526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.129591] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.158327] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1548.158549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.632862] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49e506d-62f2-4518-a039-ac618500914a: rpc.has_security_group_logging(os_id): False [ 1548.658309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.658485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.658616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.658875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.659022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.659262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.659390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.659464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.659653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.659755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.659991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.660127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.660207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.660378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.660481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.660709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.660829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.660922] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.661125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.661228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.661339] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1548.724384] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.724587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.724633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.724855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.725053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.738355] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1549.288856] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1549.289105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.289281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.289515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.289710] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.289833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.289936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.290104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.290192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.290280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.290374] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.792453] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.792742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.792742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.792920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.793119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.793225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.793288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.793454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.793553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.793644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.793790] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.793883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.793946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.794110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.794268] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.794369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.794430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.794572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.794649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.794732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.794821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.299085] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c546a99-cc70-447b-86d7-8f2c7bf60dc8: rpc.has_security_group_logging(os_id): False [ 1550.318465] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.318683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.318683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.318876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.318960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.319198] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.319340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.319404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.319565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.319642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.319823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.319997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.320073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.320215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.320291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.320468] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.320563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.320621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.320758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.320832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.320917] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be created. [ 1550.391483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.391732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.391839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.392330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.392651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.405962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1550.730782] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.730899] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1550.755051] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1550.755313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.417888] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1552.417888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.255430] env[71051]: INFO networking_nsxv3.common.synchronization [req-91372da9-6b78-4ce8-a572-4fb416ff9814 req-e2ead58e-4297-4b30-9326-3edc510f00e4 tempest-VolumesAssistedSnapshotsTest-2110512825 tempest-VolumesAssistedSnapshotsTest-2110512825-project-member] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1554.256008] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGHEST for action security_group_members [ 1554.256321] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.256442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.256522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.256734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.256851] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.256951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.257020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.257174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.257261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.257356] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.759847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.760121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.760212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.760458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.781311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.781565] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.781686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.781756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.782037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.782115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.782217] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 is going to be updated. [ 1554.805074] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.805226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.805318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.805532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.805672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.813789] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: IN_PROGRESS for 2s [ 1556.304977] env[71051]: INFO networking_nsxv3.common.synchronization [req-18729da1-c7d2-4379-94b6-4b9da0b10ab0 req-e36075cd-df9c-495a-ab2e-08f2dc409688 tempest-ImagesOneServerTestJSON-1939875970 tempest-ImagesOneServerTestJSON-1939875970-project-member] Enqueued Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1556.305341] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGHEST for action security_group_members [ 1556.305402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.306042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.306042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.306042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.306042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.306042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.306373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.306373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.306373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.306373] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1556.809056] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.809169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.809206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.809840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.809840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.809840] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.809840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.810035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.810066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.810218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.810276] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b is going to be updated. [ 1556.822521] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 in Status: SUCCESS [ 1556.822765] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 deletion is rescheduled due to dependency. [ 1556.822897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.835502] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.835681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.835789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.836062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.836249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.843603] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: IN_PROGRESS for 2s [ 1558.854718] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638b0340-fa12-4f4e-b327-be39d30aa06b in Status: SUCCESS [ 1558.854718] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b deletion is rescheduled due to dependency. [ 1558.855071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.985145] env[71051]: INFO networking_nsxv3.common.synchronization [req-b4b589c6-d556-45a9-9197-ecc4ee3e355b req-5619fb2d-9e0c-45f0-8480-78088fa982b7 tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1559.985744] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1559.986236] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.986401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.986541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.986775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.986966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.987113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.987204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.987432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.987493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.987614] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.288601] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.288827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.289711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.289711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.289711] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.289711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.289937] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.290338] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.290338] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.290431] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1560.290543] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1560.290754] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1560.290905] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1560.291035] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1560.291155] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1560.291294] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1560.309470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1560.309641] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1560.309776] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1560.309957] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.310305] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.310476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.310591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.310928] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.312167] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.489968] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.814813] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.815514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.815707] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.816022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.816188] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.816352] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 not found, creating... [ 1560.816630] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.816799] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.816918] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.817187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.817409] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.817757] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.818054] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.818416] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.818664] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.818812] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.818962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 is going to be created. [ 1560.837021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.837246] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.837357] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.837628] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.837858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.838103] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.994291] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.496318] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.496478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.496524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.496769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.496856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.496960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1561.530459] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.530603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.530718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.530878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.531028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.543286] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1561.580666] env[71051]: INFO networking_nsxv3.common.synchronization [req-b4b589c6-d556-45a9-9197-ecc4ee3e355b req-9fdbc5c3-0df8-4f8c-9a5a-a249a5d0e2df service nova] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_rules [ 1561.580888] env[71051]: INFO networking_nsxv3.common.synchronization [req-b4b589c6-d556-45a9-9197-ecc4ee3e355b req-9fdbc5c3-0df8-4f8c-9a5a-a249a5d0e2df service nova] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1561.581055] env[71051]: INFO networking_nsxv3.common.synchronization [req-b4b589c6-d556-45a9-9197-ecc4ee3e355b req-9fdbc5c3-0df8-4f8c-9a5a-a249a5d0e2df service nova] Enqueued Resource ID: 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 with Priority: HIGHEST for action port [ 1561.581235] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_rules [ 1561.581370] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1561.581537] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 with Priority: HIGHEST for action port [ 1561.582295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.582496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.582745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.582862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.582985] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.583937] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.584047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.584269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.584400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.584469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.585046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.585099] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.089774] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.090086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.090134] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 with status ACTIVE [ 1562.091038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.091038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.091038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.091038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.091038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.091355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.091355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.091355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.091620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.091759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.091928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.092111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.092168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.092319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.092395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.092483] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6 is going to be updated. [ 1562.111648] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.111807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.111849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.112126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.112260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.112421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2231a3a5-2bba-4fd9-93ad-ff9a2cbdfcd6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.712337] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ea468fa-d154-4eb9-99f1-2f48fdc030b1 req-5aa9456f-da28-4cca-addb-e223b83867d4 tempest-ServerActionsV293TestJSON-1541438298 tempest-ServerActionsV293TestJSON-1541438298-project-member] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1562.712908] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1562.713227] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.713353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.713420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.714036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.714210] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.714342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.714404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.714569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.714678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.714773] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.088914] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.090317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-150" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.090317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-150" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.090317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-150" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.090317] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.090317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.090317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.090973] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.090973] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.090973] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1563.090973] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1563.090973] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1563.091179] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1563.091327] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1563.091467] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1563.091625] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1563.111110] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1563.111325] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1563.112035] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1563.112035] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-150" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.112166] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-44266805-5b05-48a8-90ad-cc2c697b29fe taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.112308] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.112383] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.112785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.112946] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44266805-5b05-48a8-90ad-cc2c697b29fe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.219837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.219837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.219837] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 already deleted. [ 1563.219837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.553914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1563.554034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.554236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.554476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.554674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.554829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.555036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.555118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.555216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.555317] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.615575] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.615823] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.615952] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.616258] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.616412] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.616569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 44266805-5b05-48a8-90ad-cc2c697b29fe not found, creating... [ 1563.616826] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.616986] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.617121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.617338] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.617477] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.617756] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.617909] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.618041] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.618255] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.618391] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.618531] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 44266805-5b05-48a8-90ad-cc2c697b29fe is going to be created. [ 1563.639299] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.639501] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.639625] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.639891] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.640184] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.640413] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.058378] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.474405] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ea468fa-d154-4eb9-99f1-2f48fdc030b1 req-f3130276-f57b-41df-a62a-059a3cd7b395 service nova] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1564.474405] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ea468fa-d154-4eb9-99f1-2f48fdc030b1 req-f3130276-f57b-41df-a62a-059a3cd7b395 service nova] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1564.474405] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ea468fa-d154-4eb9-99f1-2f48fdc030b1 req-f3130276-f57b-41df-a62a-059a3cd7b395 service nova] Enqueued Resource ID: 44266805-5b05-48a8-90ad-cc2c697b29fe with Priority: HIGHEST for action port [ 1564.474752] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_rules [ 1564.474752] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1564.474811] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44266805-5b05-48a8-90ad-cc2c697b29fe with Priority: HIGHEST for action port [ 1564.475368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.475462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.475548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.475809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.475909] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.478056] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.478056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.478056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.478056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.478056] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.478056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.478056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.478339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.478339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.484028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.484028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-44266805-5b05-48a8-90ad-cc2c697b29fe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.484028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.484028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.484028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.484028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44266805-5b05-48a8-90ad-cc2c697b29fe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.559701] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.904275] env[71051]: INFO networking_nsxv3.common.synchronization [req-c75ecca1-778f-4875-8068-c3ac9b7aaef6 req-3b014407-3f8d-4816-84e3-1c0a390e1141 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1564.905585] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1564.905914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.906073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.906147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.906375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.906546] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.906642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.906704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.906865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.906960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.907072] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.985205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.985357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.986146] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.987105] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44266805-5b05-48a8-90ad-cc2c697b29fe with status ACTIVE [ 1564.987296] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.987428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.987519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.987805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.987897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.988112] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.988215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.988276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.988454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.988545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.988755] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.988897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.989015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.989272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.989401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.989557] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44266805-5b05-48a8-90ad-cc2c697b29fe is going to be updated. [ 1565.012566] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.012748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.012834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.013106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.013231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.013440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44266805-5b05-48a8-90ad-cc2c697b29fe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.064512] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.064512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.064512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.064512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.064512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.064512] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1565.093044] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.093494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.093494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.093752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.093909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.103468] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1565.332262] env[71051]: INFO networking_nsxv3.common.synchronization [req-8e1782b4-440a-470c-82ab-096d08b55804 req-e71c94e1-2a58-4bc6-83e4-ae58b06090af tempest-InstanceActionsTestJSON-567079658 tempest-InstanceActionsTestJSON-567079658-project-member] Enqueued Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1565.332865] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1565.333242] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.333404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.333471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.333800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.333963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.334091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.334190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.334358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.334446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.334542] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.409151] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.409322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.409395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.409628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.409723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.409928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.410156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.410224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.410388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.410469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.410560] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1565.435819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.435976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.436067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.436651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.436815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.451241] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1565.494472] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.763984] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.763984] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-737" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.764167] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-737" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.764397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-737" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.765067] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.765067] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.765067] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.765263] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.765422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.765639] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1565.765757] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1565.766126] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1565.766126] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1565.766413] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1565.766596] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1565.766765] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1565.788435] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1565.788435] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1565.788435] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1565.788628] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-737" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.788963] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4394d67f-963f-4be2-8ca3-d8045009c47e taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.789499] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.789499] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.789782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.789954] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4394d67f-963f-4be2-8ca3-d8045009c47e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.836830] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.837036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.837124] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.837425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.837476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.837670] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.837765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.837806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.837944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.839046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.839046] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae already deleted. [ 1565.839046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.995665] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.995665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.995665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.996469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.996556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.996693] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 is going to be created. [ 1566.019182] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.019330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.019446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.019721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.019895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.028292] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: UNINITIALIZED for 2s [ 1566.293415] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.293687] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.293843] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.294203] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.294386] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.294630] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4394d67f-963f-4be2-8ca3-d8045009c47e not found, creating... [ 1566.294943] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.295113] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.295390] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.295641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.295779] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.296470] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.296670] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.296796] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.297105] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.297284] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.297488] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4394d67f-963f-4be2-8ca3-d8045009c47e is going to be created. [ 1566.317264] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.317405] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.317941] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.317941] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.318163] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.322022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.071521] env[71051]: INFO networking_nsxv3.common.synchronization [req-8e1782b4-440a-470c-82ab-096d08b55804 req-043d9025-3926-4bc7-b12a-dad373acfa8e service nova] Enqueued Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_rules [ 1567.071760] env[71051]: INFO networking_nsxv3.common.synchronization [req-8e1782b4-440a-470c-82ab-096d08b55804 req-043d9025-3926-4bc7-b12a-dad373acfa8e service nova] Enqueued Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1567.071760] env[71051]: INFO networking_nsxv3.common.synchronization [req-8e1782b4-440a-470c-82ab-096d08b55804 req-043d9025-3926-4bc7-b12a-dad373acfa8e service nova] Enqueued Resource ID: 4394d67f-963f-4be2-8ca3-d8045009c47e with Priority: HIGHEST for action port [ 1567.072246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_rules [ 1567.072376] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1567.072578] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4394d67f-963f-4be2-8ca3-d8045009c47e with Priority: HIGHEST for action port [ 1567.075270] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.075417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.075488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.075823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.075866] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.077078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.077201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.077269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.077454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.077616] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.077800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.077800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.077919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.078119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.078119] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.078962] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4394d67f-963f-4be2-8ca3-d8045009c47e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.079036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.079074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.079221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.079299] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4394d67f-963f-4be2-8ca3-d8045009c47e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.113624] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.113624] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.113624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.113624] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.464877] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1567.464877] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1567.464877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.580798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.580938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.582320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4394d67f-963f-4be2-8ca3-d8045009c47e with status ACTIVE [ 1567.582533] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.582645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.582774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.583118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.583118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.583329] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.583465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.583501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.583709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.583746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.583910] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.584016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.584078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.584220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.584290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.584410] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4394d67f-963f-4be2-8ca3-d8045009c47e is going to be updated. [ 1567.585449] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.612120] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.612120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.612120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.612120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.612120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.613950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4394d67f-963f-4be2-8ca3-d8045009c47e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.618127] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.619263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.619340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.619564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.619748] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.619860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.619928] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.620447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.620447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.620447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.620447] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.620666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.620666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.620735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.620843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.620924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.620997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.621189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.621266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.621350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.621443] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.044942] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: SUCCESS [ 1568.044942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.044942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.044942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.044942] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.044942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.045776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.046189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.047588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.047588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.047588] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.090328] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.124039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c546a99-cc70-447b-86d7-8f2c7bf60dc8: rpc.has_security_group_logging(os_id): False [ 1568.148592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.148592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.148729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.148929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.148991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.149306] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.149401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.149437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.149638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.149698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.149862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.149979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.150051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.151732] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.151732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.152271] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1568.228996] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.228996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.228996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.228996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.228996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.246445] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1568.273938] env[71051]: INFO networking_nsxv3.common.synchronization [req-d1ccf219-e611-4aa1-86d0-c5e09f0c7005 req-e86f808b-2026-433f-bef9-2ecc70ca691f tempest-ServerMetadataNegativeTestJSON-107875937 tempest-ServerMetadataNegativeTestJSON-107875937-project-member] Enqueued Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1568.274924] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1568.274924] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.275144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.275144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.275601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.275601] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.276399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.276399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.276499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.276499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.276609] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.549548] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.592711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.592874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.592935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.593240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.593578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.593578] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae is going to be created. [ 1568.622173] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.622378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.622478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.623146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.623146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.649024] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: UNINITIALIZED for 2s [ 1568.725218] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.725423] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-733" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.725503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-733" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.726071] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-733" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.726416] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.726591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.726719] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.726962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.727130] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.727353] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1568.727526] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1568.727592] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1568.727683] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1568.727794] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1568.727924] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1568.728129] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1568.748720] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1568.748936] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1568.749053] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1568.749275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-733" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.749724] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2481d251-181e-4318-ade1-5864cbc1e023 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.749925] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.750089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.750425] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.750563] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2481d251-181e-4318-ade1-5864cbc1e023',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.780835] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.780975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.780975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.781188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.781292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.781500] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.781620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.781704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.781830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.781904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.783260] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 already deleted. [ 1568.783476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.057353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9efbdb84-0e00-421d-96e9-16064575b3b4: rpc.has_security_group_logging(os_id): False [ 1569.082628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.082628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.082628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.082628] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 is going to be created. [ 1569.144814] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.145162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.145229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.145615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.145851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.160632] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: IN_PROGRESS for 2s [ 1569.257104] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.257104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.257397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.257461] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.257637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.257822] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2481d251-181e-4318-ade1-5864cbc1e023 not found, creating... [ 1569.258112] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.258267] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.258442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.258681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.258848] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.259156] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.259282] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.259524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.259616] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.259701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.259906] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2481d251-181e-4318-ade1-5864cbc1e023 is going to be created. [ 1569.283620] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.283824] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.283974] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.284342] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.284575] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.284811] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.259834] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1570.260175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.576735] env[71051]: INFO networking_nsxv3.common.synchronization [req-d1ccf219-e611-4aa1-86d0-c5e09f0c7005 req-eb7331f4-3559-46fd-99b3-1d4766a33b8b service nova] Enqueued Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_rules [ 1570.576735] env[71051]: INFO networking_nsxv3.common.synchronization [req-d1ccf219-e611-4aa1-86d0-c5e09f0c7005 req-eb7331f4-3559-46fd-99b3-1d4766a33b8b service nova] Enqueued Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1570.577070] env[71051]: INFO networking_nsxv3.common.synchronization [req-d1ccf219-e611-4aa1-86d0-c5e09f0c7005 req-eb7331f4-3559-46fd-99b3-1d4766a33b8b service nova] Enqueued Resource ID: 2481d251-181e-4318-ade1-5864cbc1e023 with Priority: HIGHEST for action port [ 1570.577703] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_rules [ 1570.577910] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1570.578052] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2481d251-181e-4318-ade1-5864cbc1e023 with Priority: HIGHEST for action port [ 1570.578367] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.578483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.578829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.579232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.579419] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.580794] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.580794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.580794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.580969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.583347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.583347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.583347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.583347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.583347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.583347] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.583347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2481d251-181e-4318-ade1-5864cbc1e023 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.583347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.584232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.584232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.584232] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2481d251-181e-4318-ade1-5864cbc1e023',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.678761] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: SUCCESS [ 1570.678998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.679214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.679451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.679641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.679755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.679821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.679955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.680129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.680226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.680357] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.838940] env[71051]: INFO networking_nsxv3.common.synchronization [req-fc242a39-6460-4349-9b53-65f76abb7585 req-4b80aed4-5fc0-40bc-8424-782467da3561 tempest-FloatingIPsAssociationTestJSON-2072692805 tempest-FloatingIPsAssociationTestJSON-2072692805-project-member] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1570.839459] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGHEST for action security_group_members [ 1570.839769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.839880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.839948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.840613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.840783] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.840886] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.840954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.841166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.841261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.841406] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.089581] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.090850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.093114] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.093114] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2481d251-181e-4318-ade1-5864cbc1e023 with status ACTIVE [ 1571.093114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.093114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.093114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.093114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.093114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.093114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.093416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.093416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.093416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.093504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.093657] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.093754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.093808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.094412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.094412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.094412] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2481d251-181e-4318-ade1-5864cbc1e023 is going to be updated. [ 1571.113687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.113869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.113943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.114184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.114648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.114833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2481d251-181e-4318-ade1-5864cbc1e023" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.138159] env[71051]: INFO networking_nsxv3.common.synchronization [req-e4fa8530-491a-4efe-ac11-1a65ea7ad443 req-de651c13-f274-48c4-bdf8-4d4edd810ba2 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1571.138159] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1571.138341] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.138499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.138579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.138960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.139969] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.139969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.139969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.139969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.139969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.140372] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.174470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: SUCCESS [ 1571.174470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.183987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.184149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.184149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.184494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.184604] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.184792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.184792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.184938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.184983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.185094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.185245] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.185345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.185412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.185557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.185699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.185807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.185846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.185986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.186076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.186225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.186335] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.347089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.347089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.347675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be updated. [ 1571.380987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.381179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.381247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.381436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.381595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.392427] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: IN_PROGRESS for 2s [ 1571.596749] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.601551] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.601760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.601905] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.602247] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.602518] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.602680] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.602790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.603112] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.603292] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.603687] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1571.603687] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1571.603815] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1571.603815] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1571.603926] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1571.604065] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1571.604229] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1571.642017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1571.642017] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1571.642017] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1571.642017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.642344] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.642545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.642676] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.643221] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.643485] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94aa93d3-f766-4d99-9ac3-7c7bae64c3ca',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.645088] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.645385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.645576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.645981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.646110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.646688] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.646688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.646819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.646912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.648098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.648098] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 already deleted. [ 1571.648098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.690925] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbff40c-25f8-4329-bef5-8a0d7c1eabae: rpc.has_security_group_logging(os_id): False [ 1571.726089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.726089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.726089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.727243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.727243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.727243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.727243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.730736] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.730736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.730736] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae is going to be created. [ 1571.801681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.801681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.801681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.801909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.802140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.813587] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: IN_PROGRESS for 2s [ 1572.098465] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.098672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.099673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.099673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.099673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.099673] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 is going to be created. [ 1572.124314] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.124639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.124639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.124940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.125032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.133912] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: UNINITIALIZED for 2s [ 1572.149766] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.150120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.150350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.150587] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.150775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.150945] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca not found, creating... [ 1572.151264] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.151583] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.151583] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.151801] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.151973] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.152397] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.152606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.152813] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.152951] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.153264] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.153481] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca is going to be created. [ 1572.173625] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.173855] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.173989] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.174342] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.174739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.174924] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.600205] env[71051]: INFO networking_nsxv3.common.synchronization [req-a69bbf2e-1bb0-487d-9bd6-9a966af4cde2 req-3cccd599-82d0-4d53-ad88-e13b5be84251 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1572.601517] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1572.601517] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.601517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.601517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.601805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.602261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.602644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.602743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.603647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.603647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.603647] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.641242] env[71051]: INFO networking_nsxv3.common.synchronization [req-a69bbf2e-1bb0-487d-9bd6-9a966af4cde2 req-3cccd599-82d0-4d53-ad88-e13b5be84251 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1572.641356] env[71051]: INFO networking_nsxv3.common.synchronization [req-a69bbf2e-1bb0-487d-9bd6-9a966af4cde2 req-3cccd599-82d0-4d53-ad88-e13b5be84251 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1572.641714] env[71051]: INFO networking_nsxv3.common.synchronization [req-a69bbf2e-1bb0-487d-9bd6-9a966af4cde2 req-3cccd599-82d0-4d53-ad88-e13b5be84251 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1572.643659] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1572.643973] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1572.643973] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1572.644262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.644436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.644504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.644732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.644821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.646273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.646374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.646574] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b44405a-b451-4f95-9b01-f45548608a87 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.646701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.646770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.646954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.648438] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b44405a-b451-4f95-9b01-f45548608a87',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.781950] env[71051]: INFO networking_nsxv3.common.synchronization [req-5db56da5-c181-4867-b9e1-e75f87ad8104 req-9a2ac1b7-1e70-4c92-b411-5d567e734956 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1572.783230] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1572.783667] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.783727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.783799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.784047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.784215] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.784416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.784416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.784534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.784620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.786158] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.110488] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.150984] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.150984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.151232] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b44405a-b451-4f95-9b01-f45548608a87 with status ACTIVE [ 1573.151329] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.151438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.151504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.151885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.151885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.151985] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.152110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.152169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.152323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.152406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.152584] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.152707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.152772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.152917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.152995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.153099] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b44405a-b451-4f95-9b01-f45548608a87 is going to be updated. [ 1573.174262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.174262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.174423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.174510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.174659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.174794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.276875] env[71051]: INFO networking_nsxv3.common.synchronization [req-e4fa8530-491a-4efe-ac11-1a65ea7ad443 req-172f3b18-a62c-47c4-8b7d-0be8f631e623 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1573.276875] env[71051]: INFO networking_nsxv3.common.synchronization [req-e4fa8530-491a-4efe-ac11-1a65ea7ad443 req-172f3b18-a62c-47c4-8b7d-0be8f631e623 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1573.276964] env[71051]: INFO networking_nsxv3.common.synchronization [req-e4fa8530-491a-4efe-ac11-1a65ea7ad443 req-172f3b18-a62c-47c4-8b7d-0be8f631e623 service nova] Enqueued Resource ID: 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca with Priority: HIGHEST for action port [ 1573.277539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1573.277759] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1573.281033] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca with Priority: HIGHEST for action port [ 1573.281033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.281033] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.281033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.281033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.281033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.281700] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.282146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.282262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.282328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.282485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.282562] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94aa93d3-f766-4d99-9ac3-7c7bae64c3ca',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.288629] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.288797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.288868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.289085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.289213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.289436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.289542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.289620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.289839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.290016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.290169] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1573.322675] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.322866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.322939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.323134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.323295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.332664] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1573.410185] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe in Status: SUCCESS [ 1573.410367] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe deletion is rescheduled due to dependency. [ 1573.410483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.613668] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.784894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.787359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.787359] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.787639] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca with status ACTIVE [ 1573.787639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.787779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.787856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.788146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.788249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.788462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.788615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.788689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.788879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.788979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.790508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.790823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.790823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.790994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.790994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.791137] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94aa93d3-f766-4d99-9ac3-7c7bae64c3ca is going to be updated. [ 1573.811737] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.811737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.811737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.811737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.811737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.811737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94aa93d3-f766-4d99-9ac3-7c7bae64c3ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.825836] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: SUCCESS [ 1573.826075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.905277] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-6c3db1ec-8533-4307-9391-245057f984f3 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1573.905277] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1573.905277] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.905277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.905277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.905616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.905863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.906111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.906275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.906601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.906768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.906953] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.117887] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.118402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.118628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.119059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.119171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.119278] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be updated. [ 1574.149054] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: SUCCESS [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.149054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.149054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.149054] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.151963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.151963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.151963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.154583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.154583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.161501] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: IN_PROGRESS for 2s [ 1574.296142] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.413023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.413023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.413023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.413023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1574.441120] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.441120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.441120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.441120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.441120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.450274] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1574.655641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.655924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.655924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.656117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.656309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.656383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.656459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.656637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.656670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.656767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.656910] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.656976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.657070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.657187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.657320] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.657672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.657672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.657672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.657672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.657794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.657863] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.802120] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.802120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.802120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.802120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.802120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.802120] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be created. [ 1574.821801] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.821972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.822051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.822297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.822478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.831281] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: UNINITIALIZED for 2s [ 1574.854471] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.854471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.854471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.856015] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.856015] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.858033] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.858033] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.858033] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.858033] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.858033] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1574.858033] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1574.858705] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1574.858705] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1574.858705] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1574.858705] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1574.858851] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1574.876506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1574.876736] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1574.876821] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1574.876987] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.877344] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-6a00aa27-5946-46b9-a21f-f789c81f3e46 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.877711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.877711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.878080] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.878188] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a00aa27-5946-46b9-a21f-f789c81f3e46',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1575.165716] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a68e762-cffb-482d-a85e-c2908dcab8e6: rpc.has_security_group_logging(os_id): False [ 1575.184096] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.184287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.184376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.184581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.184681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.184896] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.185252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.185252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.185252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.185436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.185505] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.185584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.185640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.185752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.185833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.185980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.186387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.186476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.186613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.186687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.186777] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 is going to be created. [ 1575.242354] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.243190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.243190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.245177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.245177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.258201] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: IN_PROGRESS for 2s [ 1575.350636] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1575.350831] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1575.350967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.381139] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.381321] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.381653] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.382397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.382545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.382649] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 6a00aa27-5946-46b9-a21f-f789c81f3e46 not found, creating... [ 1575.382899] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.383148] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.383294] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.383760] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.384854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.384854] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.384854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.384854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.384854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.385102] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.385136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 6a00aa27-5946-46b9-a21f-f789c81f3e46 is going to be created. [ 1575.425667] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.425911] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.426055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.426646] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.427196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.427601] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.502566] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2f12746f-92ee-4a56-ab91-b282bf11d272 None None] Enqueued Resource ID: 2963fd96-6391-4cb6-b515-a95517f01b5b with Priority: HIGHEST for action port [ 1575.503441] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2963fd96-6391-4cb6-b515-a95517f01b5b with Priority: HIGHEST for action port [ 1575.503663] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2963fd96-6391-4cb6-b515-a95517f01b5b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.503827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2963fd96-6391-4cb6-b515-a95517f01b5b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.503875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2963fd96-6391-4cb6-b515-a95517f01b5b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.504936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2963fd96-6391-4cb6-b515-a95517f01b5b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.507052] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2963fd96-6391-4cb6-b515-a95517f01b5b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.011408] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2963fd96-6391-4cb6-b515-a95517f01b5b [ 1576.011408] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.011408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.011408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.011408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.011408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.011408] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2963fd96-6391-4cb6-b515-a95517f01b5b already deleted. [ 1576.011408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2963fd96-6391-4cb6-b515-a95517f01b5b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.172445] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1576.172770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.173138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.173430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.174971] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.175207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.175312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.175567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.175696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.175827] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.352704] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-6d72ae80-2a19-42f7-af03-e8f0aacdf4d4 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1576.352901] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-6d72ae80-2a19-42f7-af03-e8f0aacdf4d4 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1576.353057] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-6d72ae80-2a19-42f7-af03-e8f0aacdf4d4 service nova] Enqueued Resource ID: 6a00aa27-5946-46b9-a21f-f789c81f3e46 with Priority: HIGHEST for action port [ 1576.353646] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1576.353818] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1576.353940] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a00aa27-5946-46b9-a21f-f789c81f3e46 with Priority: HIGHEST for action port [ 1576.356153] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.356153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.356153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.356296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.357578] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.358296] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.358296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.358396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a00aa27-5946-46b9-a21f-f789c81f3e46 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.358510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.358579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.358778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.358865] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a00aa27-5946-46b9-a21f-f789c81f3e46',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.463978] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1576.464383] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c deletion is rescheduled due to dependency. [ 1576.464562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.464753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.464991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.465220] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.465369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.465461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.465645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.465760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.465881] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.678465] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.841967] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1576.842400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.842680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.842993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.843309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.843648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.843648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.843772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.844050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.844050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.844160] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.863331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.863331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.863331] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a00aa27-5946-46b9-a21f-f789c81f3e46 with status ACTIVE [ 1576.863501] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.863703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.863703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.863943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.864049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.864262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.864377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.864440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.864770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.864770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.864914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.868020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.868020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.868020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.868020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.868020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a00aa27-5946-46b9-a21f-f789c81f3e46 is going to be updated. [ 1576.886431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.886585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.886651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.886863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.886995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.887174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a00aa27-5946-46b9-a21f-f789c81f3e46" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.967907] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.063424] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-f07f68a1-4905-4da4-a1c6-c6e6e330f87b tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1577.063989] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1577.064932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.064932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.183419] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.270343] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: SUCCESS [ 1577.270514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.349016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.349016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.349016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.349016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.349016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.349615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.349615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.349615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.349615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.349615] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.373588] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.373859] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.374133] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.374533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.374884] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.375858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.376105] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.376447] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.377592] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.378055] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1577.378304] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1577.378495] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1577.378680] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1577.379717] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1577.379717] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1577.379717] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1577.402044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1577.402044] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1577.402044] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1577.402044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-931" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.402044] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-90430c29-ca43-4e97-b852-7f88fbe3879d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.402044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.402044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.402044] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.402044] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90430c29-ca43-4e97-b852-7f88fbe3879d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.472483] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.561040] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 1577.561179] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:1 started [ 1577.658502] env[71051]: INFO networking_nsxv3.common.synchronization [req-81aaa92c-491e-43f2-b261-bed1079fb899 req-2fc0f80c-dce8-4f80-ae26-ecf72cee84a7 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1577.659076] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1577.659384] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.659492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.685773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.688349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.688349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.688349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.688349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.688349] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be updated. [ 1577.695018] env[71051]: INFO networking_nsxv3.common.synchronization [req-81aaa92c-491e-43f2-b261-bed1079fb899 req-2fc0f80c-dce8-4f80-ae26-ecf72cee84a7 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1577.695018] env[71051]: INFO networking_nsxv3.common.synchronization [req-81aaa92c-491e-43f2-b261-bed1079fb899 req-2fc0f80c-dce8-4f80-ae26-ecf72cee84a7 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1577.695018] env[71051]: INFO networking_nsxv3.common.synchronization [req-81aaa92c-491e-43f2-b261-bed1079fb899 req-2fc0f80c-dce8-4f80-ae26-ecf72cee84a7 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1577.695018] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_rules [ 1577.695018] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1577.695713] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44405a-b451-4f95-9b01-f45548608a87 with Priority: HIGHEST for action port [ 1577.696152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.696516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.696959] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.698717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.698717] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b44405a-b451-4f95-9b01-f45548608a87 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.698717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.698717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.698717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.698717] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b44405a-b451-4f95-9b01-f45548608a87',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.715020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.715020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.715020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.715020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.715020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.725444] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: IN_PROGRESS for 2s [ 1577.853280] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1577.871457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.871663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.871719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.871905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.871998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.872416] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.872531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.872596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.872758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.873686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.873911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.874089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.874089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.874265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.874356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.874538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.874635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.874699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.874843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.874923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.875027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be created. [ 1577.904772] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.905327] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.905327] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.905479] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.905647] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.905802] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 90430c29-ca43-4e97-b852-7f88fbe3879d not found, creating... [ 1577.906073] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.906348] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.906348] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.906888] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.906888] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.907049] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.907438] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.907438] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.909484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.909484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.909484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 90430c29-ca43-4e97-b852-7f88fbe3879d is going to be created. [ 1577.931910] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.931910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.931910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.932686] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.932686] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.932890] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.935442] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.935627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.935722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.935941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.936155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.950830] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1577.977773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.977773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.977773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.978237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.978380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.978518] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1578.009247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.009743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.009856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.010051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.010220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.027134] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1578.204035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b44405a-b451-4f95-9b01-f45548608a87 with status ACTIVE [ 1578.204035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.204035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.204035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.204035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.204778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.204778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.204778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.204778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.204778] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b44405a-b451-4f95-9b01-f45548608a87 is going to be updated. [ 1578.229619] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.229619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.229619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.229619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.230023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.230023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b44405a-b451-4f95-9b01-f45548608a87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.335675] env[71051]: INFO networking_nsxv3.common.synchronization [req-b7c76c09-3821-4cbc-8dc7-9f149e62b19c req-acdf009c-522e-4433-9ee6-2ada98b30323 tempest-ServersV294TestFqdnHostnames-1299815983 tempest-ServersV294TestFqdnHostnames-1299815983-project-member] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1578.336308] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGHEST for action security_group_members [ 1578.336654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.336787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.336859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.337711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.337711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.337711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.337711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.337711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.338080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.338080] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.385505] env[71051]: INFO networking_nsxv3.common.synchronization [None req-5f856bb2-704b-412b-abd0-22e3a3c41fd4 None None] Enqueued Resource ID: 55e298b9-00ff-471a-92ef-7be017c06ba1 with Priority: HIGHEST for action port [ 1578.386349] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e298b9-00ff-471a-92ef-7be017c06ba1 with Priority: HIGHEST for action port [ 1578.386687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-55e298b9-00ff-471a-92ef-7be017c06ba1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.386852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55e298b9-00ff-471a-92ef-7be017c06ba1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.386919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55e298b9-00ff-471a-92ef-7be017c06ba1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.388510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55e298b9-00ff-471a-92ef-7be017c06ba1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.388510] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55e298b9-00ff-471a-92ef-7be017c06ba1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-a1a92ccc-110e-4427-9e3e-e3bbb24c10f7 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-a1a92ccc-110e-4427-9e3e-e3bbb24c10f7 service nova] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e74616-043e-4b87-ad6c-f2a983c482b9 req-a1a92ccc-110e-4427-9e3e-e3bbb24c10f7 service nova] Enqueued Resource ID: 90430c29-ca43-4e97-b852-7f88fbe3879d with Priority: HIGHEST for action port [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_rules [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1578.783359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90430c29-ca43-4e97-b852-7f88fbe3879d with Priority: HIGHEST for action port [ 1578.790976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.790976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.790976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.791351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.791745] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-90430c29-ca43-4e97-b852-7f88fbe3879d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.791871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.793577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.793577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.793577] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90430c29-ca43-4e97-b852-7f88fbe3879d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.839928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.840191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.840272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.840510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.866286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.866720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.866993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.869507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.869507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.869507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.869507] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 is going to be updated. [ 1578.890989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55e298b9-00ff-471a-92ef-7be017c06ba1 [ 1578.891246] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.891389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.891460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.891682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.891776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.891874] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55e298b9-00ff-471a-92ef-7be017c06ba1 already deleted. [ 1578.891960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55e298b9-00ff-471a-92ef-7be017c06ba1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.906480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.906678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.906718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.906917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.907077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.917871] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: IN_PROGRESS for 2s [ 1579.296418] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90430c29-ca43-4e97-b852-7f88fbe3879d with status ACTIVE [ 1579.296741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.296865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.296865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.297115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.297935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.297935] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.297935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.297935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.297935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.297935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.298214] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.298214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.298214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.298311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.298339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.298416] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90430c29-ca43-4e97-b852-7f88fbe3879d is going to be updated. [ 1579.319899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.320700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.320700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.320700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.320700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.321021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90430c29-ca43-4e97-b852-7f88fbe3879d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.738709] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1579.738949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.739162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.739446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.739646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.739770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.739841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.740027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.740129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.740220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.744067] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.744978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.745710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.745959] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.746152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.746415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.746648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.746791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.746941] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.962898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1579.963145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.040026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.040026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.040026] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.040026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.042140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.042426] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.042650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.042794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.046756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.046756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.046756] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.251171] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.252162] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.547034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.547301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.547424] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.755974] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.758716] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b939b9-34f2-43da-9107-07642c640846: rpc.has_security_group_logging(os_id): False [ 1580.778537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.779426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.779532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.780206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.780206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.780385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.780461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.780541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.780770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.780907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.781067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be updated. [ 1580.848092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.848092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.848092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.848092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.848420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.865476] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: IN_PROGRESS for 2s [ 1580.931236] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 in Status: SUCCESS [ 1580.931465] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 deletion is rescheduled due to dependency. [ 1580.931621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.050783] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.258779] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.258939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.258981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.259224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.259323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.259429] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be updated. [ 1581.287127] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.287323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.287436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.287838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.287888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.296053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: IN_PROGRESS for 2s [ 1581.553625] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.554016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.554016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.554222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.554263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.554366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1581.580772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.581022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.581022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.581245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.581370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.590281] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1582.038600] env[71051]: INFO networking_nsxv3.common.synchronization [req-84a188da-9a5d-412a-8f46-aff9a2ab4971 req-059ea3ed-8bbc-4a91-8d43-66b24cba5cc0 tempest-AttachInterfacesUnderV243Test-146843102 tempest-AttachInterfacesUnderV243Test-146843102-project-member] Enqueued Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1582.040010] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b939b9-34f2-43da-9107-07642c640846 with Priority: HIGHEST for action security_group_members [ 1582.040728] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b939b9-34f2-43da-9107-07642c640846 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.041093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.417660] env[71051]: INFO networking_nsxv3.common.synchronization [req-e06b535b-469c-4857-8168-da026cfcac37 req-5194d229-1333-4192-95ba-3d91ec076d6b tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1582.418243] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1582.418544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.418684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.418754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.418969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.420694] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.421069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.421069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.421134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.421192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.421307] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.854510] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.854510] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.854510] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.854510] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.854510] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.855075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.855075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.855621] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.856562] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.856562] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1582.856562] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1582.856562] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1582.856562] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1582.856868] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1582.856868] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1582.857091] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1582.879833] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1582.879961] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1582.880115] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1582.880790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.880790] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-08087dd4-26fb-485f-99e6-df5bf91d14db taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.880953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.880991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.881353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.881505] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08087dd4-26fb-485f-99e6-df5bf91d14db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.884331] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1582.884575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.884843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.885045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.885445] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.928198] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.306645] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b939b9-34f2-43da-9107-07642c640846 in Status: SUCCESS [ 1583.307170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.307499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.309063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.309063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.309063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.309063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.309063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.309063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.309063] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.387975] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.388342] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.388547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.388853] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.389136] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.389317] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 08087dd4-26fb-485f-99e6-df5bf91d14db not found, creating... [ 1583.389610] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.389765] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.389882] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.390128] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.390288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.390579] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.390727] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.390832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.391055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.391196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.391452] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 08087dd4-26fb-485f-99e6-df5bf91d14db is going to be created. [ 1583.409654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.409654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.409654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.409888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.409888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.409888] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be deleted. [ 1583.415569] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.415749] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.415878] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.416162] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.416391] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.416619] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.430232] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.495397] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.495685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.495842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.496176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.496341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.496583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.608374] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1583.608700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.608942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.609217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.609434] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.609718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.609820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.610034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.610129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.610254] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.816543] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.816728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.816772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.816996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.817118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.817315] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.817483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.817483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.817636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.817714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.817803] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 is going to be deleted. [ 1583.843484] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.843649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.843692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.843906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.844015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.844196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.844263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.844433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.844580] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.844680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.844800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.844878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.844957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.845062] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b939b9-34f2-43da-9107-07642c640846',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.936337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.936619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.936619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.936851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.936948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.937067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be updated. [ 1583.968293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.968380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.968458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.968678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.968831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.986706] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1584.113079] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.125089] env[71051]: INFO networking_nsxv3.common.synchronization [req-e06b535b-469c-4857-8168-da026cfcac37 req-da367a93-6826-4819-894c-b0acbc6106e3 service nova] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_rules [ 1584.125089] env[71051]: INFO networking_nsxv3.common.synchronization [req-e06b535b-469c-4857-8168-da026cfcac37 req-da367a93-6826-4819-894c-b0acbc6106e3 service nova] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1584.125089] env[71051]: INFO networking_nsxv3.common.synchronization [req-e06b535b-469c-4857-8168-da026cfcac37 req-da367a93-6826-4819-894c-b0acbc6106e3 service nova] Enqueued Resource ID: 08087dd4-26fb-485f-99e6-df5bf91d14db with Priority: HIGHEST for action port [ 1584.126504] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_rules [ 1584.127069] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1584.127645] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08087dd4-26fb-485f-99e6-df5bf91d14db with Priority: HIGHEST for action port [ 1584.127966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.129350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.129350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.129350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.129350] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.130766] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.131077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.131560] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-08087dd4-26fb-485f-99e6-df5bf91d14db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.131744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.131899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.133467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.133467] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08087dd4-26fb-485f-99e6-df5bf91d14db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.347206] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.347375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.347451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.347678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.347770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.347986] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.348139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.348187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.348373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.348415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.348561] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b939b9-34f2-43da-9107-07642c640846 already deleted. [ 1584.348594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b939b9-34f2-43da-9107-07642c640846" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.617279] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.631700] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.631857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.635697] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08087dd4-26fb-485f-99e6-df5bf91d14db with status ACTIVE [ 1584.635964] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.636158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.636256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.636496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.636618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.636822] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.636947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.637030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.637323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.637323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.637490] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.638019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.638019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.638019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.638019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.638019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08087dd4-26fb-485f-99e6-df5bf91d14db is going to be updated. [ 1584.672150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.672365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.672445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.672731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.672904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.673141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08087dd4-26fb-485f-99e6-df5bf91d14db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.119237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.119237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.119237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.120788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.120788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.120788] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1585.147264] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.147843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.147843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.147843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.147843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.156536] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1585.247344] env[71051]: INFO networking_nsxv3.common.synchronization [req-bb2da6c1-7d91-4631-9b7f-49176b409f21 req-a4bac90a-c0e8-4a80-b6c1-b4e6423daf2e tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1585.248135] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1585.248568] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.248853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.249056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.249359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.249650] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.251563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.251563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.251563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.251563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.251563] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.663146] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-814 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.663146] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.663378] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.663648] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.664537] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.664537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.664537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.664722] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.665124] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.665357] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1585.665473] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1585.665584] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1585.665698] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1585.665808] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1585.665916] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1585.666064] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1585.698267] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1585.698473] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1585.698589] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1585.698772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.699120] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.699301] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.699421] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.699834] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.699988] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.754762] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.754934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.754998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.758029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.758029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.758029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1585.786207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.786366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.786437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.786650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.786795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.797627] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1585.970446] env[71051]: INFO networking_nsxv3.common.synchronization [req-0c20c4dc-0e17-4973-8f50-fab0af79bbcc req-66ac2c9a-d17e-4c07-9d2d-e866a5429d87 tempest-ServerMetadataNegativeTestJSON-107875937 tempest-ServerMetadataNegativeTestJSON-107875937-project-member] Enqueued Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1585.970976] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGHEST for action security_group_members [ 1585.971376] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.971485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.971523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.971715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.971878] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.971982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.972187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.972309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.972393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.972506] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.996036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1585.996129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.997438] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.997438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.997438] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.205936] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.206446] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.206446] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.206623] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.206773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.206942] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a not found, creating... [ 1586.207255] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.207426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.207546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.207785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.207930] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.208256] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.208421] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.208542] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.208795] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.208896] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.209064] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a is going to be created. [ 1586.227719] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.228424] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.228634] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.229017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.229300] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.229632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.475022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.475258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.475358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.475596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.475719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.475915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.476072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.476107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.476506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.476506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.476506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 is going to be updated. [ 1586.495123] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.495123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.495349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.495517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.495665] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.499818] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.502192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.502400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.502505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.502784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.502959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.512237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: IN_PROGRESS for 2s [ 1586.998406] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.006871] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.168262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1587.168491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.168657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.169040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.169112] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.169204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.169256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.169413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.169496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.169583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.169739] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.169834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.169901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.170062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.170232] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.170330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.170391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.170536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.170608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.171647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.171715] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [req-bb2da6c1-7d91-4631-9b7f-49176b409f21 req-3a25fe27-dde5-4130-92ac-5a16e39c8c4f service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [req-bb2da6c1-7d91-4631-9b7f-49176b409f21 req-3a25fe27-dde5-4130-92ac-5a16e39c8c4f service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [req-bb2da6c1-7d91-4631-9b7f-49176b409f21 req-3a25fe27-dde5-4130-92ac-5a16e39c8c4f service nova] Enqueued Resource ID: afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a with Priority: HIGHEST for action port [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1587.192036] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a with Priority: HIGHEST for action port [ 1587.193436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.193884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.193884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.194031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.194114] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.196834] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.196834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.198216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.198363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.198430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.202164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.202164] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.502603] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.516022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.516022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.516022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.516022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.516022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.516022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be updated. [ 1587.545808] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.545968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.546055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.546281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.546433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.557205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1587.675626] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764cf243-3a8f-4abc-8bb0-1036c78cc82c: rpc.has_security_group_logging(os_id): False [ 1587.697431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.697651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.697793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.698061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.698198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.698436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.698570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.698675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.698943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.699061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.699229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.699327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.700444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.700638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.700718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.700946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.701116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.701116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.701309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.701441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.701574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1587.703414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.703555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.704914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a with status ACTIVE [ 1587.704914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.704914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.704914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.704914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.706412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.706412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.706412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.706412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.706412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.706412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.706412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.706788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.706788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.707870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.707870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.707870] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a is going to be updated. [ 1587.732721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.732897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.732897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.733152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.733306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.733475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afdbc1d4-70d4-4fcf-a288-e4253b8e7c8a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.775397] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.775552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.775590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.776113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.776113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.795221] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1587.816653] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1587.816653] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b deletion is rescheduled due to dependency. [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.816653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.816653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.816653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.007792] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1588.010144] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1588.219890] env[71051]: INFO networking_nsxv3.common.synchronization [req-a8332e5f-f7a6-455b-8843-c11729c998ca req-3f352d3c-3ce6-4642-a281-e513a0f5fba3 tempest-InstanceActionsTestJSON-567079658 tempest-InstanceActionsTestJSON-567079658-project-member] Enqueued Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1588.220666] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGHEST for action security_group_members [ 1588.221040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.221212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.221366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.221523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.221721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.221868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.221983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.222203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.222322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.222390] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.321365] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.529055] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 in Status: SUCCESS [ 1588.529400] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 deletion is rescheduled due to dependency. [ 1588.529400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.725124] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.725449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.726043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.726043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.726611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.726611] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.726700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.726731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.727099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.727277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.727481] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae is going to be updated. [ 1588.758186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.758423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.758549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.758827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.759020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.764210] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.764404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.764572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.764813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.779448] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1588.780776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.782103] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1588.784658] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: IN_PROGRESS for 2s [ 1588.810802] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.811018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.811112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.812754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.817430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.818150] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1588.818150] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1588.818234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1588.823925] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.852498] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.852657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.852736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.853861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.854778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.855037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1588.910205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.910392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.910500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.910839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.911104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.911361] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1588.965681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.966179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.966344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.966633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.967940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.967940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 1588.967940] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3f55dfd0-8351-4e68-b5e1-565d69ffd85c', 'e70fb2ce-bed4-4221-be40-0a6c62d651e1', '6c546a99-cc70-447b-86d7-8f2c7bf60dc8', 'd25bc2bf-35b9-46ff-8995-4834b28ed22a', '042bdb74-254e-4d12-a03c-f947b0627cf4', '5dbff40c-25f8-4329-bef5-8a0d7c1eabae', 'a49e506d-62f2-4518-a039-ac618500914a', '6a68e762-cffb-482d-a85e-c2908dcab8e6', 'dd3d690a-4535-4aec-bcff-77d18d84cfbe', '5ae8e1de-8780-45e2-92a4-0586208d5513', '6c6810b9-50d2-45a8-bd88-0a9b6019a88d', '29c8230f-81e9-43ef-8adc-85278751b6d7', '638b0340-fa12-4f4e-b327-be39d30aa06b', 'a8620a6a-16cb-4fc6-af53-e0b0622d304d', '0c2fd4bb-40e7-467a-aac0-215f99a17824', '062ccdf8-4c1d-4d6e-b731-e0c7de49b27b', '8f5aee31-afbb-467a-9d2a-71123fe133d1', 'fb27aac1-26b8-4e44-9313-936316b62525', '3eb910ff-24da-4a21-bff7-7efb598948f2', '3d06bf6c-ef7f-42d0-911f-d260f48bffe2', '7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b', '3bba870c-b5d9-4661-a3d0-55e05367a8db', '5c611102-ef9e-4425-9ced-e6be888b77ae', 'e2469f80-4eb1-4a87-9a72-0d981b145113', 'abff08ff-fc06-4dbe-a011-a141e9aba9d4', '6235e93c-519f-43a7-8c8b-5c8b7d56575b', 'a48a7216-9768-452e-a3d9-cf477a05890c', '9efbdb84-0e00-421d-96e9-16064575b3b4', '61b3ef5c-fe30-4fa8-843f-b800b5921066', '6b6fa828-b174-4bb7-a914-8abc9f68e473', '1bbb30ff-0400-4ec6-ade0-aa4c2a91880b', '7f2493d4-27de-4333-a7cd-5237d967e052', '764cf243-3a8f-4abc-8bb0-1036c78cc82c'} {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1588.967940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1588.989198] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.989198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.989198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.989198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.989198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.989466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1588.989466] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1588.989466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1589.047449] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.047449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.047449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.047688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.049754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.050270] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1589.050270] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1589.050270] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1589.050270] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1589.050270] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 1589.050603] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGH for action security_group_rules [ 1589.050603] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGH for action security_group_rules [ 1589.050725] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 1589.050833] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGH for action security_group_rules [ 1589.050948] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGH for action security_group_rules [ 1589.051029] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGH for action security_group_rules [ 1589.051111] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGH for action security_group_rules [ 1589.051175] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGH for action security_group_rules [ 1589.051256] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGH for action security_group_rules [ 1589.051440] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGH for action security_group_rules [ 1589.051502] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGH for action security_group_rules [ 1589.051564] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 1589.051623] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGH for action security_group_rules [ 1589.051686] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGH for action security_group_rules [ 1589.051740] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGH for action security_group_rules [ 1589.051797] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGH for action security_group_rules [ 1589.051854] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGH for action security_group_rules [ 1589.052246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGH for action security_group_rules [ 1589.052246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGH for action security_group_rules [ 1589.052714] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGH for action security_group_rules [ 1589.053949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.327365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.327946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.328176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.328461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.328613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.328760] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1589.354599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.354760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.354877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.355185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.355377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.364420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1589.569278] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.569278] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.569278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.570829] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.812204] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1589.812560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.812794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.813051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.813157] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.075279] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.075524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.075649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.075826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.077055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.077055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.077055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.077581] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.077581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.077581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.077698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.077698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.077792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.077886] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.318168] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.318168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.318861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.318861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.319550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.319749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.321114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.322211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.322211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.322211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.322211] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.584258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b: rpc.has_security_group_logging(os_id): False [ 1590.604226] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.604400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.604450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.604655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.621604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.622078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.622299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.622362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.622559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.622623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.622920] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.623070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.623070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.623217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.623331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.624558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.624558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.624558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.624558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.624558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.624558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be updated. [ 1590.692893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.692893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.692893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.692893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.692893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.708216] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1590.804245] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae in Status: SUCCESS [ 1590.804995] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae deletion is rescheduled due to dependency. [ 1590.804995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.826349] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.826562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.826615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.827099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.827099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.827947] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.827947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.827947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.828160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.828297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.828389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.828442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.828615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.828699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.828775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.828854] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.331398] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764cf243-3a8f-4abc-8bb0-1036c78cc82c: rpc.has_security_group_logging(os_id): False [ 1591.353101] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.353277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.353384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.355332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.374984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.375559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.375559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.375559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.376290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.376290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.376290] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.376290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.376290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.376471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.376471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.377893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.377893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.377893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.377893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.377893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.377893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1591.383771] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1591.384550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.384550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.384550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.384818] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.384818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.384818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.385086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.385086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.385218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.385350] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.441711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.441895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.441968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.442267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.442429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.456904] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1591.510679] env[71051]: INFO networking_nsxv3.common.synchronization [req-e68d0656-3eed-4a60-8f48-92d0d7a25d7c req-48c009ed-5d4e-48a1-b6b4-e0e1c5df72be tempest-ServersTestJSON-579992493 tempest-ServersTestJSON-579992493-project-member] Enqueued Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1591.511552] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGHEST for action security_group_members [ 1591.511768] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c with Priority: HIGH for action security_group_rules [ 1591.511988] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 1591.512034] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGH for action security_group_rules [ 1591.512199] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 with Priority: HIGH for action security_group_rules [ 1591.512336] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGH for action security_group_rules [ 1591.512819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGH for action security_group_rules [ 1591.513067] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b0340-fa12-4f4e-b327-be39d30aa06b with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d with Priority: HIGH for action security_group_rules [ 1591.514273] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 with Priority: HIGH for action security_group_rules [ 1591.515753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGH for action security_group_rules [ 1591.515940] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.516228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.516451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.516674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.516868] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.517015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.517114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.517369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.517478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.517579] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.519186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.519186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.519186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.519438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.519548] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f55dfd0-8351-4e68-b5e1-565d69ffd85c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.521897] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.522106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.522268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.522636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.522993] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.524836] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.525062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.525270] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.527325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.527325] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.527325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c2fd4bb-40e7-467a-aac0-215f99a17824 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.527325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.527325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.527879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.527879] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c2fd4bb-40e7-467a-aac0-215f99a17824',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.529132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.529236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.529341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.529470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.529576] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.531406] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.531406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.531406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.531602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.531602] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.532805] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.532995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.532995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.533186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.533502] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.536087] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.536087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.536087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.536087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.536087] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.536819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.536998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.537593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.537593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.537593] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.537813] env[71051]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 1591.539089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.539089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.539089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.539323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.539425] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.540682] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638b0340-fa12-4f4e-b327-be39d30aa06b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.540682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.540990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.541068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.541166] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638b0340-fa12-4f4e-b327-be39d30aa06b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.542286] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.542508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.542613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.542844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.543018] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.544225] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.544337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.544493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.544735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.544856] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6810b9-50d2-45a8-bd88-0a9b6019a88d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.545827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ae8e1de-8780-45e2-92a4-0586208d5513 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.546074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.546205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.546397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.546498] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ae8e1de-8780-45e2-92a4-0586208d5513',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.547899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.549654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.549871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.550148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.550393] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd3d690a-4535-4aec-bcff-77d18d84cfbe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.551563] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.551861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.551861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.552613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.552613] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbff40c-25f8-4329-bef5-8a0d7c1eabae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.553326] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a68e762-cffb-482d-a85e-c2908dcab8e6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.553468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.553579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.553824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.553909] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a68e762-cffb-482d-a85e-c2908dcab8e6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.554978] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042bdb74-254e-4d12-a03c-f947b0627cf4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.555217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.555304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.555530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.555662] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042bdb74-254e-4d12-a03c-f947b0627cf4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.558073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.558073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.558073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.558073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.558073] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e70fb2ce-bed4-4221-be40-0a6c62d651e1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.558073] env[71051]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1591.559186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.559330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.559427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.559641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.559763] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.597688] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.597688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.597688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.598293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.627163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.627284] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f55dfd0-8351-4e68-b5e1-565d69ffd85c is going to be deleted. [ 1591.692862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.693036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.693036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.693493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.693698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.694021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f55dfd0-8351-4e68-b5e1-565d69ffd85c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.887777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.887979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.888605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.888605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.888605] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.888605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.888828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.888879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.888966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.889053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.889207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.889389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.889389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.889581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.889676] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.889770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.889821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.889964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.890079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.890169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.890283] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.062215] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.062384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.062459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.062734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.062856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.062963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.063069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.063186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.063278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.063367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.063460] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.064632] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.068340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.068465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.068666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.089587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.089862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.089991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.090111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.090342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.090428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.090545] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d is going to be updated. [ 1592.105292] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.105474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.105561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.105775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.106032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.109232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.109391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.109587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.109678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.109774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.109896] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.119211] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.119353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.119404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.119613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.119753] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.119852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.119917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.120098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.120174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.120690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.120690] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.122442] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.122585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.122646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.122827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.122985] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.123689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.123689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.123689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.123689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.123689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.123689] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.124606] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.124721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.124788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.124975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.125143] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.125243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.125307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.125532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.125653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.125708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.125753] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.126771] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.126879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.126879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.127021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.127403] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.127403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.127403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.127602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.127602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.127602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.127710] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.129951] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.130096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.130188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.130394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.130546] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.130717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.130717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.131035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.131035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.131035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.131293] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.131976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.132131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.132323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.132559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.132970] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.133084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.133084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.133242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.133325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.133426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.133543] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.138390] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.138775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.138775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.138993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.139194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.139377] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d is going to be deleted. [ 1592.143531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.143531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.143727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.143933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.144173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.190828] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: IN_PROGRESS for 2s [ 1592.196040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.196040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.196040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.196040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.200522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.200522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.200522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.200522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.200522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.200522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.201113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.201113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.202325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.202460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.204026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.204026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.204612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.204753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.205523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.205838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.207743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.207903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.217351] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1592.218040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.218222] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a68e762-cffb-482d-a85e-c2908dcab8e6 is going to be deleted. [ 1592.219235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.219500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.240327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.240327] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042bdb74-254e-4d12-a03c-f947b0627cf4 is going to be deleted. [ 1592.241328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.241528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.243297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.243420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.264044] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.264044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.266829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.266996] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be deleted. [ 1592.268084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.268317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.287179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.287560] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c2fd4bb-40e7-467a-aac0-215f99a17824 is going to be deleted. [ 1592.288704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.289031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.309207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.309358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.324468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.324468] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3d690a-4535-4aec-bcff-77d18d84cfbe is going to be deleted. [ 1592.325306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.325522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.337627] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.337764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.348154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.348565] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ae8e1de-8780-45e2-92a4-0586208d5513 is going to be deleted. [ 1592.349633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.350303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.355025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.355181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.395414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.397097] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be deleted. [ 1592.398203] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b: rpc.has_security_group_logging(os_id): False [ 1592.403245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.403245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.411566] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.411566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.446386] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.446521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.460756] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.461279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.461819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.461955] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbff40c-25f8-4329-bef5-8a0d7c1eabae is going to be deleted. [ 1592.462948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.465969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.498555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.498696] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638b0340-fa12-4f4e-b327-be39d30aa06b is going to be deleted. [ 1592.499952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.500247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.551718] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.552864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.561825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.562033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e70fb2ce-bed4-4221-be40-0a6c62d651e1 is going to be deleted. [ 1592.563134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.563366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.563511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.563679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.563862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.564038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.564135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.564309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a68e762-cffb-482d-a85e-c2908dcab8e6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.564940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.565174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.565294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.565492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042bdb74-254e-4d12-a03c-f947b0627cf4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.565634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.565786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.565867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.565981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.566133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.566271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.566349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.566457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c2fd4bb-40e7-467a-aac0-215f99a17824" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.566580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.566756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.566877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.567065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd3d690a-4535-4aec-bcff-77d18d84cfbe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.567218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.567368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.570826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.570960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.571326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.571326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.571483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.571483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.571617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.571679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.571813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.571869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.571978] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.572092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.572233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.573536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.573689] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.576175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.576175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.576175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.576175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.576175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.576175] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.605665] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.606034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.612690] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.639965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.640327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.640472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.640544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.641089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.641089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.641255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.641255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.641501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.641501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.641604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.642203] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.642203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.642203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.642203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.642487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.642487] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1592.644019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.644142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.644197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.644312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ae8e1de-8780-45e2-92a4-0586208d5513" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.644494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.644584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.644637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.644723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.644872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.645021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.645183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.645304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbff40c-25f8-4329-bef5-8a0d7c1eabae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.649198] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.649198] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.649420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.649420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.649558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.649709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.649868] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.649963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.650040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.650192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.650284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.650407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.650510] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.650599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.650660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.650792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.650924] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.651034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.651105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.651229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.651322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.651400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.651481] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.652946] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.653637] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.654719] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.662404] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.662662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.662840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.663222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.663417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.664019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638b0340-fa12-4f4e-b327-be39d30aa06b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.694119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.694119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.694119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.694677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.694773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.694854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e70fb2ce-bed4-4221-be40-0a6c62d651e1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.727532] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1592.728437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.768402] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1592.769109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.769349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.769349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.769506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.769672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.829564] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1593.032823] env[71051]: INFO networking_nsxv3.common.synchronization [req-5ceb6312-87e9-4216-a754-3d241d2a68f6 req-aff3cbba-cf50-445f-a1e6-a6ff99e6f57a tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1593.033771] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1593.034179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.034279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.034403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.034871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.035115] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.035267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.035356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.035579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.035726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.035901] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.076940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c546a99-cc70-447b-86d7-8f2c7bf60dc8: rpc.has_security_group_logging(os_id): False [ 1593.095128] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.095311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.095385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.095666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.113162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.113483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.113609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.113776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.113874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.114599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.114599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.114599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.114599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.114599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.114891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.115196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.115311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.115311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.116466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.116466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.116466] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1593.117418] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8620a6a-16cb-4fc6-af53-e0b0622d304d: rpc.has_security_group_logging(os_id): False [ 1593.139359] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.139359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.139359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.139359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.149363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f5aee31-afbb-467a-9d2a-71123fe133d1: rpc.has_security_group_logging(os_id): False [ 1593.164018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.164018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.164018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.164018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.164018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.164018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.164018] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d is going to be updated. [ 1593.164449] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3eb910ff-24da-4a21-bff7-7efb598948f2: rpc.has_security_group_logging(os_id): False [ 1593.164947] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1593.166031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb27aac1-26b8-4e44-9313-936316b62525: rpc.has_security_group_logging(os_id): False [ 1593.166784] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 1593.167299] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d25bc2bf-35b9-46ff-8995-4834b28ed22a: rpc.has_security_group_logging(os_id): False [ 1593.168810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.169038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.169038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.169135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.193118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.193300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.194061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.196994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.196994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.196994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.196994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.196994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.197450] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.197567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.198334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.198599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.198695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.198765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.198974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.199089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.199189] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 is going to be updated. [ 1593.201095] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.201209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.201369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.201484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.201574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.202628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.202795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.222646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.222976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.223091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.223184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.223396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.223489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.223616] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 is going to be updated. [ 1593.224644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.224853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.226478] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1593.257743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.258022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.258157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.258227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.261269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.261269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.261269] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.261269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.270260] env[71051]: INFO networking_nsxv3.common.synchronization [req-aa769141-f21a-4fda-ac36-ed08e77cb6e6 req-06b05fa1-5d9b-4f1a-be19-2ae1c53db939 tempest-MultipleCreateTestJSON-1908118469 tempest-MultipleCreateTestJSON-1908118469-project-member] Enqueued Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1593.270890] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c with Priority: HIGHEST for action security_group_members [ 1593.271206] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-764cf243-3a8f-4abc-8bb0-1036c78cc82c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.271404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.285570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.285726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.322818] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.322984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.325959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.326288] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.326388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.326455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.326673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.326759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.326965] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1593.327916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.328159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.376117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.376877] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.376877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.376877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.376877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.376877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.377149] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a is going to be updated. [ 1593.378077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.378258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.378397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.379258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.379515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.379691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.380521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.380685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.400409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.400547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.403824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.403915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.417760] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: IN_PROGRESS for 2s [ 1593.429347] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: IN_PROGRESS for 2s [ 1593.429347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.429347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.429347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.429347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.429347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.429347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.429347] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27aac1-26b8-4e44-9313-936316b62525 is going to be updated. [ 1593.430896] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.431144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.433398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.433398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.433398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.433398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.495459] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: IN_PROGRESS for 2s [ 1593.496259] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1593.509183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.509183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.509183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.509183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.509183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.533887] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1593.534162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.540256] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.552597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.552844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.552932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.554169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.554508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.557198] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.557393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.557563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.557848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.558060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.568619] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1593.577519] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: IN_PROGRESS for 2s [ 1593.581035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: IN_PROGRESS for 2s [ 1594.043286] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.141731] env[71051]: INFO networking_nsxv3.common.synchronization [req-69ffe9ef-0b2a-4c84-ac32-f3039465dbce req-44ea9f0c-4472-4a9f-8d89-374ed4195e71 tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1594.142315] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1594.142973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.143130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.144385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.144507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.144661] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.144773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.144831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.145032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.145112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.145191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.199880] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d in Status: SUCCESS [ 1594.199993] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6810b9-50d2-45a8-bd88-0a9b6019a88d deletion is rescheduled due to dependency. [ 1594.200154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6810b9-50d2-45a8-bd88-0a9b6019a88d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.545139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.545348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.545438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.545650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.545741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.545849] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1594.573027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.573027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.573027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.573027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.573027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.578651] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1594.647180] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.647362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.647553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.647723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.647835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.648109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.648264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.648383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.648572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.648689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.648794] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f already deleted. [ 1594.648887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.843506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1594.843870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.033632] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.033882] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.034026] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.034443] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.034750] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.034925] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.035061] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.035299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.035474] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.035708] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1595.035827] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1595.035942] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1595.036109] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1595.036348] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1595.036425] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1595.036542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1595.058258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1595.058663] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1595.058663] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1595.058787] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.059142] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-95cb5c04-d490-44b6-88f7-614ad609b439 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.059333] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.059468] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.063371] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.063546] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95cb5c04-d490-44b6-88f7-614ad609b439',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.240778] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1595.241148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.433455] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: SUCCESS [ 1595.433767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.440929] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: SUCCESS [ 1595.441238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.511453] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: SUCCESS [ 1595.511701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.512562] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1595.512736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.566527] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.566803] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.566943] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.567280] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.567465] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.567701] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 95cb5c04-d490-44b6-88f7-614ad609b439 not found, creating... [ 1595.567924] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.568114] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.568250] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.568500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.568669] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.568983] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.569841] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.569841] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.569841] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.569841] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.571026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 95cb5c04-d490-44b6-88f7-614ad609b439 is going to be created. [ 1595.589263] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1595.589383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.590217] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: SUCCESS [ 1595.590459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.591924] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: SUCCESS [ 1595.592324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.596024] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.596024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.596024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.596024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.596024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.596024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.325024] env[71051]: INFO networking_nsxv3.common.synchronization [req-69ffe9ef-0b2a-4c84-ac32-f3039465dbce req-bf653f8d-b9c8-4ce4-8b32-2ba5a5dc5d2d service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1596.325312] env[71051]: INFO networking_nsxv3.common.synchronization [req-69ffe9ef-0b2a-4c84-ac32-f3039465dbce req-bf653f8d-b9c8-4ce4-8b32-2ba5a5dc5d2d service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1596.325361] env[71051]: INFO networking_nsxv3.common.synchronization [req-69ffe9ef-0b2a-4c84-ac32-f3039465dbce req-bf653f8d-b9c8-4ce4-8b32-2ba5a5dc5d2d service nova] Enqueued Resource ID: 95cb5c04-d490-44b6-88f7-614ad609b439 with Priority: HIGHEST for action port [ 1596.325604] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1596.325733] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1596.325832] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cb5c04-d490-44b6-88f7-614ad609b439 with Priority: HIGHEST for action port [ 1596.326390] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.326831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.326831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.326831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.326976] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.332193] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.332338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.334219] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.334219] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.334219] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-95cb5c04-d490-44b6-88f7-614ad609b439 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.334219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.334761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.334761] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95cb5c04-d490-44b6-88f7-614ad609b439',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.589096] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 4s [ 1596.836749] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.836749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.843022] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.843022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95cb5c04-d490-44b6-88f7-614ad609b439 with status ACTIVE [ 1596.843022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.843022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.843022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.843022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.843746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.843746] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95cb5c04-d490-44b6-88f7-614ad609b439 is going to be updated. [ 1596.869789] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.869789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.869789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.869789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.869789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.869789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95cb5c04-d490-44b6-88f7-614ad609b439" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.346575] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.851563] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.852431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.852431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.852431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.852431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.852431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be created. [ 1597.856252] env[71051]: INFO networking_nsxv3.common.synchronization [req-d2d03307-3519-4096-99a5-f070a8f33234 req-9b9d9621-509d-41ef-936c-956eec6f6bad tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1597.857329] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1597.857746] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.858021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.858189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.858513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.858833] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.859067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.859222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.859464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.859677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.859861] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.878570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.878570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.878570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.878570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.878570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.885582] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: UNINITIALIZED for 2s [ 1598.282022] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.282022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.282022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.282022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.282022] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.282022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.282722] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.287021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.287021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.287021] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1598.287021] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1598.287021] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1598.287021] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1598.287021] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1598.287021] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1598.287021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1598.305084] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1598.305802] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1598.305802] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1598.305802] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.306581] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-1c5571ab-e1f1-4735-9722-710e0fc55e03 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.306581] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.306581] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.307218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.307218] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c5571ab-e1f1-4735-9722-710e0fc55e03',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.362508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.362861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.362861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.363102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.363102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.363311] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.363375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.363411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.363564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.363652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.363738] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d already deleted. [ 1598.363820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.599795] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1598.600090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.600347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.600563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.600824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.600971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.601076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.601222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.601323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.601427] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764cf243-3a8f-4abc-8bb0-1036c78cc82c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.809647] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.809904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.810062] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.810430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.810541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.810710] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 1c5571ab-e1f1-4735-9722-710e0fc55e03 not found, creating... [ 1598.810981] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.811171] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.811299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.811526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.811672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.811959] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.812575] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.812711] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.812953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.813109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.813356] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 1c5571ab-e1f1-4735-9722-710e0fc55e03 is going to be created. [ 1598.833564] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.833775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.833903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.834196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.834428] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.834685] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.105745] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.105745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.105745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.105745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.105982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.106321] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.106501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.106579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.106776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.106869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.106985] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c is going to be updated. [ 1599.131278] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.131437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.131490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.132114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.132335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.140538] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: IN_PROGRESS for 2s [ 1599.623450] env[71051]: INFO networking_nsxv3.common.synchronization [req-d2d03307-3519-4096-99a5-f070a8f33234 req-a9f5f42b-72ea-4435-9aa8-614e8c48920b service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 1599.623730] env[71051]: INFO networking_nsxv3.common.synchronization [req-d2d03307-3519-4096-99a5-f070a8f33234 req-a9f5f42b-72ea-4435-9aa8-614e8c48920b service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1599.623812] env[71051]: INFO networking_nsxv3.common.synchronization [req-d2d03307-3519-4096-99a5-f070a8f33234 req-a9f5f42b-72ea-4435-9aa8-614e8c48920b service nova] Enqueued Resource ID: 1c5571ab-e1f1-4735-9722-710e0fc55e03 with Priority: HIGHEST for action port [ 1599.624562] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 1599.624813] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1599.624934] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c5571ab-e1f1-4735-9722-710e0fc55e03 with Priority: HIGHEST for action port [ 1599.625593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.625731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.625795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.626129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.626179] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.627031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.627150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.627219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.627392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.627550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.627630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.627683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.627837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.627909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.627999] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.631108] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c5571ab-e1f1-4735-9722-710e0fc55e03 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.631108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.631108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.631108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.631108] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c5571ab-e1f1-4735-9722-710e0fc55e03',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.895543] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1599.895772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.895938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.896174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.896367] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.896484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.896550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.896701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.896784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.896868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.896973] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.131193] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.131193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.136025] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.136025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c5571ab-e1f1-4735-9722-710e0fc55e03 with status ACTIVE [ 1600.136025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.136025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.136025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.136025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.137550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.137798] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c5571ab-e1f1-4735-9722-710e0fc55e03 is going to be updated. [ 1600.158114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.158114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.158114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.158114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.158114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.158114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c5571ab-e1f1-4735-9722-710e0fc55e03" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.399613] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.399613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.399613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.399613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.399807] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.399807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.399907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.400091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.400091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.400240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.400298] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.400391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.400445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.400592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.400733] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.400904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.400904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.401035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.401090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.401176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.401270] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.641492] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.722531] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a234be01-c45a-4a73-8c0d-c9bd3bd85dc8 None None] Enqueued Resource ID: 78add9af-e737-4376-94bd-f5009a11826d with Priority: HIGHEST for action port [ 1600.725022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78add9af-e737-4376-94bd-f5009a11826d with Priority: HIGHEST for action port [ 1600.725022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-78add9af-e737-4376-94bd-f5009a11826d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.725022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78add9af-e737-4376-94bd-f5009a11826d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.725022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78add9af-e737-4376-94bd-f5009a11826d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.725022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78add9af-e737-4376-94bd-f5009a11826d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.725022] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78add9af-e737-4376-94bd-f5009a11826d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.904590] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9288720-d9f6-45b7-9a58-f770ce25595f: rpc.has_security_group_logging(os_id): False [ 1600.923078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.923279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.923384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.923609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.923734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.923900] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.924013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.924072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.924232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.924342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.924548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.924642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.924938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.924938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.924938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.925257] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.925387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.925477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.925866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.925866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.925960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be created. [ 1600.984440] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.984440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.984660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.984660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.984949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.996960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1601.145483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.145643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.145703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.145866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.145957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.146069] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be created. [ 1601.152802] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c in Status: SUCCESS [ 1601.152988] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764cf243-3a8f-4abc-8bb0-1036c78cc82c deletion is rescheduled due to dependency. [ 1601.153117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764cf243-3a8f-4abc-8bb0-1036c78cc82c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.168660] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.168819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.169503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.169503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.169503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.178406] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: UNINITIALIZED for 2s [ 1601.231558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78add9af-e737-4376-94bd-f5009a11826d [ 1601.231670] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.231785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.231848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.232127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.232318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.232422] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78add9af-e737-4376-94bd-f5009a11826d already deleted. [ 1601.232516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78add9af-e737-4376-94bd-f5009a11826d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.348421] env[71051]: INFO networking_nsxv3.common.synchronization [req-ea4443df-cfe5-4d43-806c-34b6f64ea9c8 req-9c3a43fb-0627-446b-94a3-6abfd10cd82a tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1601.348421] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1601.348421] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.349375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.349596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.349893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.350229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.350497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.350654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.350909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.351105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.351292] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.699828] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.699828] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.699828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.700651] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.700651] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1601.700651] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1601.700651] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1601.700805] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1601.700918] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1601.701067] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1601.701220] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1601.723570] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1601.723772] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1601.724619] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1601.724619] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.724619] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.724835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.724835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.725161] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.725303] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.854052] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.228383] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.228622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.230705] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c not found, creating... [ 1602.230705] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.230705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.231176] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.231176] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.231176] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.231377] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.231503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.232182] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c is going to be created. [ 1602.250177] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.250414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.250546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.250815] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.251363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.251363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.361745] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.869380] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.869380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.869380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.869380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.869380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.869380] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1602.894638] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.894801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.894856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.895755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.895755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.903282] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1602.974750] env[71051]: INFO networking_nsxv3.common.synchronization [req-ea4443df-cfe5-4d43-806c-34b6f64ea9c8 req-0c3df4ed-8f83-4fba-9f0b-53537e705b51 service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1602.974926] env[71051]: INFO networking_nsxv3.common.synchronization [req-ea4443df-cfe5-4d43-806c-34b6f64ea9c8 req-0c3df4ed-8f83-4fba-9f0b-53537e705b51 service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1602.975281] env[71051]: INFO networking_nsxv3.common.synchronization [req-ea4443df-cfe5-4d43-806c-34b6f64ea9c8 req-0c3df4ed-8f83-4fba-9f0b-53537e705b51 service nova] Enqueued Resource ID: a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c with Priority: HIGHEST for action port [ 1602.975362] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1602.976082] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1602.976082] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c with Priority: HIGHEST for action port [ 1602.981347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.981347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.981347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.981347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.981347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.981347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.981347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.981672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.981672] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.000568] env[71051]: INFO networking_nsxv3.common.synchronization [None req-84e1b37f-4fd7-472a-9a6e-0b0e1e24c03c None None] Enqueued Resource ID: 811cc005-9bd6-46e6-b3cd-33ba1d6046e5 with Priority: HIGHEST for action port [ 1603.001511] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811cc005-9bd6-46e6-b3cd-33ba1d6046e5 with Priority: HIGHEST for action port [ 1603.001853] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-811cc005-9bd6-46e6-b3cd-33ba1d6046e5 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.001992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-811cc005-9bd6-46e6-b3cd-33ba1d6046e5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.002091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-811cc005-9bd6-46e6-b3cd-33ba1d6046e5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.002354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-811cc005-9bd6-46e6-b3cd-33ba1d6046e5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.002440] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('811cc005-9bd6-46e6-b3cd-33ba1d6046e5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.010782] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1603.011018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.011194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.011465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.011557] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.188797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 1603.189850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.189850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.190034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.190513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.190703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.190859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.191270] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.191342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.191453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.191590] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.485227] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c with status ACTIVE [ 1603.485842] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.486039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.486039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.486301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.486637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.486637] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.486784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.486836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.487527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.487527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.487527] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.487527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.487527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.487820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.487820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.487820] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c is going to be updated. [ 1603.504924] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 811cc005-9bd6-46e6-b3cd-33ba1d6046e5 [ 1603.505183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.505940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.506254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.506499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.506591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.506909] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:811cc005-9bd6-46e6-b3cd-33ba1d6046e5 already deleted. [ 1603.506909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-811cc005-9bd6-46e6-b3cd-33ba1d6046e5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.514662] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.514662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.521714] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.521714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.521714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.521714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.521714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.521714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a03c3aa6-4057-4af4-8e72-4a3e85e8fd2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.694577] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.694577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.694577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.694832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.694997] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.695106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.695177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.695326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.695417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.695514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.695669] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.695752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.695822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.695952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.696594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.696594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.696594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.696594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.696594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.696594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.696594] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.198446] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59190f66-54f4-449e-a67c-42ef58b0914d: rpc.has_security_group_logging(os_id): False [ 1604.218301] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.218456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.218532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.218747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.218838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.219064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.219167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.219223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.219422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.219464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.219662] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.219780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.219826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.219955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.220041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.220253] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.220747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.220747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.220747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.220747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.220747] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be created. [ 1604.278650] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.279092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.279092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.279315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.279629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.290039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 1604.479144] env[71051]: INFO networking_nsxv3.common.synchronization [None req-08fbd2fe-c4ac-441a-ae13-20b4e8ab09e3 tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1604.479700] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1604.480018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.480150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.480213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.480477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.480565] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.592119] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a07b3ad3-999d-451f-ba99-65cc737ae299 tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1604.592119] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1604.593250] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.593250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.916260] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1604.916567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.917190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.917461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.917730] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.917905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.918025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.918219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.918362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.918485] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.000084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.000201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.000201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.000474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.000584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.000684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1569210-7f11-407a-992e-cc729f87d941 already deleted. [ 1605.000768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.001297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.001502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.001584] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.421662] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.526965] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.526965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.527138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.527625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.527625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.527625] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1569210-7f11-407a-992e-cc729f87d941 already deleted. [ 1605.527625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.924430] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.974212] env[71051]: INFO networking_nsxv3.common.synchronization [req-298549bb-1402-490d-b898-dd2da0b92077 req-8b5440dc-ff4a-48dc-847c-ae13f51fda9b tempest-DeleteServersAdminTestJSON-2104320323 tempest-DeleteServersAdminTestJSON-2104320323-project-member] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1605.974616] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1605.974955] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.975490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.975607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.977459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.977687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.978098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.978098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.978313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.978701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.978842] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1606.301234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 1606.301475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.309638] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.309842] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.309970] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.310293] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.310560] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.310725] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.310859] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.311175] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.311297] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.311504] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1606.311623] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1606.311735] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1606.311854] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1606.311978] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1606.312114] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1606.312294] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1606.329424] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1606.329601] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1606.329742] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1606.329914] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.330288] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.330457] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.330581] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.330931] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.331135] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1606.427121] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.427697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.427697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.427822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.427880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.427944] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1606.454883] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.455030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.455091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.455285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.455443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.468152] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1606.483626] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.483626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.483626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.483926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.503200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.503293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.503533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.503533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.504961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.504961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.504961] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be updated. [ 1606.529778] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.529963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.530929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.531095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.531238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.540137] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1606.837266] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.837589] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.837727] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.838087] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.838562] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.838562] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 not found, creating... [ 1606.838731] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.839672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.839672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.839672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.839672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.839802] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.839945] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.843296] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.843616] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.843772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.843969] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 is going to be created. [ 1606.872969] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.872969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.872969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.872969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.872969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.872969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.769819] env[71051]: INFO networking_nsxv3.common.synchronization [req-298549bb-1402-490d-b898-dd2da0b92077 req-fa63c1e6-e6ad-4989-aae4-8d5db22977e8 service nova] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_rules [ 1607.770150] env[71051]: INFO networking_nsxv3.common.synchronization [req-298549bb-1402-490d-b898-dd2da0b92077 req-fa63c1e6-e6ad-4989-aae4-8d5db22977e8 service nova] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1607.770150] env[71051]: INFO networking_nsxv3.common.synchronization [req-298549bb-1402-490d-b898-dd2da0b92077 req-fa63c1e6-e6ad-4989-aae4-8d5db22977e8 service nova] Enqueued Resource ID: 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 with Priority: HIGHEST for action port [ 1607.770344] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_rules [ 1607.770479] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1607.770579] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 with Priority: HIGHEST for action port [ 1607.771209] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.771357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.771427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.771605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.771716] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.772646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.772931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.773079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.773079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.773197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.773319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.773390] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.276364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.276535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.276693] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 with status ACTIVE [ 1608.276863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.277031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.277031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.277341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.277484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.277677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.277784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.277838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.277991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.278077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.278261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.278370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.278500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.278556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.278629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.278713] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14 is going to be updated. [ 1608.299279] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.299279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.299531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.299531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.299951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.299951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e5c3c89-99b7-4a3c-a8dc-f7f0669b7c14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.486040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1608.486276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.486455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.486684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.486882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.486995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.487420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.487539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.487595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.487639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.487743] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.551638] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1608.552784] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 deletion is rescheduled due to dependency. [ 1608.552784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.552784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.552784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.552784] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.552784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.552784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.553418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.553418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.553418] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.826630] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e65af1-aed0-4a9a-bf19-4e5e9bb97536 req-febade50-90b3-4367-b9d4-c41a54ff1774 tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1608.827446] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1608.827992] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.828516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.828594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.829312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.829516] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.831049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.831144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.831327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.831431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.831530] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.991847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.992057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.056154] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.221975] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.221975] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.221975] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.221975] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.225512] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.225512] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.225697] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.225961] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.226192] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.226498] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1609.226653] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1609.226780] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1609.226927] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1609.227082] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1609.227539] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1609.227757] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1609.246462] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1609.246710] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1609.246856] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1609.247104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.247496] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4dc705e7-8c2a-43ac-9911-d44c82643e8c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.247710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.247863] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.248659] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.248872] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc705e7-8c2a-43ac-9911-d44c82643e8c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.334967] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.558703] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.755575] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.756021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.756021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.756344] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.756533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.756724] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4dc705e7-8c2a-43ac-9911-d44c82643e8c not found, creating... [ 1609.757025] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.757197] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.757353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.757673] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.757758] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.758187] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.758428] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.758601] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.758852] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.759075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.759266] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4dc705e7-8c2a-43ac-9911-d44c82643e8c is going to be created. [ 1609.779720] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.779960] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.780105] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.780436] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.780678] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.780912] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.837543] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.062155] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.062423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.062483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.062712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.062806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.062909] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be updated. [ 1610.091796] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.092014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.092101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.092395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.092545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.103300] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1610.340082] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.341324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.341445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.341678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.341791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.341880] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1610.371399] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.371552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.371722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.372095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.372263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.384506] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1610.495148] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e65af1-aed0-4a9a-bf19-4e5e9bb97536 req-d45002dd-46d0-43b8-8fbd-925c365a283d service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1610.495523] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e65af1-aed0-4a9a-bf19-4e5e9bb97536 req-d45002dd-46d0-43b8-8fbd-925c365a283d service nova] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1610.495811] env[71051]: INFO networking_nsxv3.common.synchronization [req-16e65af1-aed0-4a9a-bf19-4e5e9bb97536 req-d45002dd-46d0-43b8-8fbd-925c365a283d service nova] Enqueued Resource ID: 4dc705e7-8c2a-43ac-9911-d44c82643e8c with Priority: HIGHEST for action port [ 1610.496541] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_rules [ 1610.496731] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1610.496853] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc705e7-8c2a-43ac-9911-d44c82643e8c with Priority: HIGHEST for action port [ 1610.497289] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.497413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.497743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.497873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.498136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc705e7-8c2a-43ac-9911-d44c82643e8c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.498312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.498486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.498713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.498836] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc705e7-8c2a-43ac-9911-d44c82643e8c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.001130] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dc705e7-8c2a-43ac-9911-d44c82643e8c with status ACTIVE [ 1611.007238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.007238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.007238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.007238] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dc705e7-8c2a-43ac-9911-d44c82643e8c is going to be updated. [ 1611.027194] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.028374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.028374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.028374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.028374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.028374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc705e7-8c2a-43ac-9911-d44c82643e8c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.489918] env[71051]: INFO networking_nsxv3.common.synchronization [None req-6ff84182-b645-4e55-9f8a-a6a8f77da1cb None None] Enqueued Resource ID: 02d548b2-b6d7-4310-a7ff-7eae6831972b with Priority: HIGHEST for action port [ 1611.491845] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02d548b2-b6d7-4310-a7ff-7eae6831972b with Priority: HIGHEST for action port [ 1611.492189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-02d548b2-b6d7-4310-a7ff-7eae6831972b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.492556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02d548b2-b6d7-4310-a7ff-7eae6831972b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.492732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02d548b2-b6d7-4310-a7ff-7eae6831972b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.492943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02d548b2-b6d7-4310-a7ff-7eae6831972b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.493043] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02d548b2-b6d7-4310-a7ff-7eae6831972b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.998053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02d548b2-b6d7-4310-a7ff-7eae6831972b [ 1611.998309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.998442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.998504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.998728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.998819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.998913] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02d548b2-b6d7-4310-a7ff-7eae6831972b already deleted. [ 1611.998997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02d548b2-b6d7-4310-a7ff-7eae6831972b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.115366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1612.115681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.115681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.117199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.117199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.117199] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.395894] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1612.396311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.396311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.396534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.396739] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.396873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.396927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.397090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.397169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.397254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.397446] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.399644] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.399644] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.399644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.400235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.400235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.400235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.400235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.400235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.400235] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.619802] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.620028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.620077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.620285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.620460] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.620568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.620630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.620787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.620876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.620967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.621132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.621230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.621294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.621439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.621592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.621696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.621746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.621888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.621968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.622065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.622153] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.901981] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9288720-d9f6-45b7-9a58-f770ce25595f: rpc.has_security_group_logging(os_id): False [ 1612.903587] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.921089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.921301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.921390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.921654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.921844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.922200] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.922880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.922880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.923121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.923121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.923349] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.923562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.923562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.923709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.923765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.923974] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.924129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.924177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.924326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.924422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.924578] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1612.984193] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.984446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.984446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.987170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.987170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.997401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1613.124557] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f2493d4-27de-4333-a7cd-5237d967e052: rpc.has_security_group_logging(os_id): False [ 1613.150030] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.150191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.150303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.150558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.150692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.150996] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.151126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.151189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.151388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.151520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.151768] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.151895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.152071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.152373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.152373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.152571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.152708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.152779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.152977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.153072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.153175] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be updated. [ 1613.329717] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.330141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.330141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.330263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.330350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.343040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1613.407067] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.911217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.911217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.911391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.911770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.911770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.911770] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1613.918825] env[71051]: INFO networking_nsxv3.common.synchronization [None req-383f42fe-4b8e-451e-adfc-b91a98ce5728 None None] Enqueued Resource ID: 244bdd7d-8258-4082-870a-0a2264bdf9c1 with Priority: HIGHEST for action port [ 1613.918825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244bdd7d-8258-4082-870a-0a2264bdf9c1 with Priority: HIGHEST for action port [ 1613.918825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-244bdd7d-8258-4082-870a-0a2264bdf9c1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.918825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244bdd7d-8258-4082-870a-0a2264bdf9c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.918825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244bdd7d-8258-4082-870a-0a2264bdf9c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.918825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244bdd7d-8258-4082-870a-0a2264bdf9c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.918825] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244bdd7d-8258-4082-870a-0a2264bdf9c1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.937827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.937973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.938050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.938699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.938699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.947387] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1613.985119] env[71051]: INFO networking_nsxv3.common.synchronization [req-2018e520-e84d-4898-a49f-e3e5301d0a15 req-f098d99d-e361-47a4-94ea-aa6ef6714678 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1613.985463] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1613.985804] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.985930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.985997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.986821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.986996] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.987125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.987194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.987358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.987447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.987546] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.422895] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 244bdd7d-8258-4082-870a-0a2264bdf9c1 [ 1614.422895] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.422895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.422895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.422895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.422895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.422895] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:244bdd7d-8258-4082-870a-0a2264bdf9c1 already deleted. [ 1614.422895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244bdd7d-8258-4082-870a-0a2264bdf9c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.489631] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.489803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.489875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.490102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.490196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.490430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.490498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.490561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.490714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.490794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.490881] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be deleted. [ 1614.516710] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.518781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.518781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.518781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.518781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.518781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.771264] env[71051]: INFO networking_nsxv3.common.synchronization [req-111f94a9-f1be-4573-9586-812e4ee62580 req-cd37cc00-d83f-4966-a3b8-1f441a1182bb tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1614.772051] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 1614.772658] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.773102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.773226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.773465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.773631] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.773764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.773831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.773974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.774077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.774169] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.833321] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.833571] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.833631] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.833905] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.834183] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.834346] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.834466] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.834730] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.834891] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.835344] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1614.835487] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1614.835667] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1614.835741] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1614.835869] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1614.835983] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1614.836150] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1614.853341] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1614.853447] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1614.854227] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1614.854227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.854430] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-3651bc05-47a2-4a94-bd8a-77b7282b8c31 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.854590] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.854766] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.856859] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.856859] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3651bc05-47a2-4a94-bd8a-77b7282b8c31',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.941036] env[71051]: INFO networking_nsxv3.common.synchronization [req-04ac4650-b4da-4bba-87c6-8c8fb728bada req-afaf0dff-0e14-47d9-83d2-521261458c6a tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1614.942161] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1614.943581] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.943719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.943784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.943988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.944161] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.944264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.944320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.944475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.944564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.944699] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.009625] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1615.009937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.010698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.010937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.011656] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.280086] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.280293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.280372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.280622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.280740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.280952] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.281061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.281122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.281289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.281368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.281454] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be updated. [ 1615.307795] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.308061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.308163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.308352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.308570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.318154] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 1615.357646] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1615.357892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.358793] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.358793] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.359042] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.359251] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.359408] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.359568] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 3651bc05-47a2-4a94-bd8a-77b7282b8c31 not found, creating... [ 1615.359855] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.360101] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.360212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.360442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.360616] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.360902] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.361077] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.361256] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.361419] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.361560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.361707] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 3651bc05-47a2-4a94-bd8a-77b7282b8c31 is going to be created. [ 1615.389599] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.390094] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.390094] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.390947] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.390947] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.390947] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.446647] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.446983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.446983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.447269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.447385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.447664] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.447782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.447842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.448103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.448211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.448314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1615.486179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.486305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.486398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.486788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.486944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.499799] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1615.517237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.517416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.956521] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1615.956782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.957018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.957231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.957454] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.957576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.957670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.958490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.958490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.958490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.958490] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.341757] env[71051]: INFO networking_nsxv3.common.synchronization [req-2018e520-e84d-4898-a49f-e3e5301d0a15 req-840187c8-2c06-40de-9cce-7af519026565 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1616.341867] env[71051]: INFO networking_nsxv3.common.synchronization [req-2018e520-e84d-4898-a49f-e3e5301d0a15 req-840187c8-2c06-40de-9cce-7af519026565 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1616.342026] env[71051]: INFO networking_nsxv3.common.synchronization [req-2018e520-e84d-4898-a49f-e3e5301d0a15 req-840187c8-2c06-40de-9cce-7af519026565 service nova] Enqueued Resource ID: 3651bc05-47a2-4a94-bd8a-77b7282b8c31 with Priority: HIGHEST for action port [ 1616.342270] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1616.342403] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1616.342519] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3651bc05-47a2-4a94-bd8a-77b7282b8c31 with Priority: HIGHEST for action port [ 1616.343107] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.343234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.343302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.343535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.343623] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.344466] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.344578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.344637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.344805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.345644] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.345644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.345644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.349341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.349341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.349341] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.349341] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3651bc05-47a2-4a94-bd8a-77b7282b8c31 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.349341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.349341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.349341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.349341] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3651bc05-47a2-4a94-bd8a-77b7282b8c31',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.461096] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.461096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.461498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.461498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.461597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.461705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.461752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.461963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.462071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.462190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.462417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.462519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.462574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.462731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.462882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.462978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.463041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.463188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.463288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.463457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.463565] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.477643] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-cae2fb05-9d34-481e-b65f-587a9411b4c7 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1616.478372] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1616.478674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.478777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.478844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.479059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.479216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.479345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.479385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.479515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.479601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.479696] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.851534] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.851685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.852073] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.855668] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3651bc05-47a2-4a94-bd8a-77b7282b8c31 with status ACTIVE [ 1616.855759] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.855859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.855923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.856207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.856265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.856416] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.856531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.856614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.856779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.856849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.857045] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.857237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.857237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.857354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.857417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.857480] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3651bc05-47a2-4a94-bd8a-77b7282b8c31 is going to be updated. [ 1616.876008] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.876199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.876269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.876437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.876571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.876733] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3651bc05-47a2-4a94-bd8a-77b7282b8c31" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.967274] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9288720-d9f6-45b7-9a58-f770ce25595f: rpc.has_security_group_logging(os_id): False [ 1616.983238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.983421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.983471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.984097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.984333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.984472] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.985183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.985183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.985183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.985183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.985405] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be deleted. [ 1616.994166] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-364f7d6b-b49a-443c-b780-d6817a4d2fe9 tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1616.995104] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.995104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.995289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.995476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.995476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.996603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.996603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.996603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.997040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.997040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.997040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.997040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.997318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.997318] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1616.998633] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1616.998941] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.999043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.013035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.013333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.013333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.013555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.013643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.013744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.014202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.014440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.014569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.014763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.014865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.014977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.015214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.015314] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1617.080677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.080894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.081116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.081850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.082122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.098450] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1617.339896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 1617.340093] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d deletion is rescheduled due to dependency. [ 1617.340206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.353732] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1617.512235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1617.512749] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b deletion is rescheduled due to dependency. [ 1617.512749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.519802] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.519967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.520212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.520279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.520327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.520506] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.520602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.520731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.520805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.520866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.521012] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b already deleted. [ 1617.521329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.591216] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-147 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.591552] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-147" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.591800] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-147" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.592904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-147" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.593887] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.594046] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.594239] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.594566] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.594967] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.595301] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1617.595448] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1617.595633] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1617.595772] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1617.595944] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1617.596126] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1617.596316] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1617.616764] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1617.617076] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1617.617150] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1617.617301] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-147" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.617642] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-e2888b20-a76e-489d-b64b-7bbe9bdbed95 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.617826] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.617951] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.618309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.618463] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2888b20-a76e-489d-b64b-7bbe9bdbed95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1617.860804] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.860804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.860804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.860804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.861064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.861064] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be created. [ 1617.884065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.884254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.884299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.884513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.884799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.893349] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: UNINITIALIZED for 2s [ 1618.122398] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.123712] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.123712] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.124481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.124481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.125032] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port e2888b20-a76e-489d-b64b-7bbe9bdbed95 not found, creating... [ 1618.125032] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.125191] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.125333] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.125825] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.125825] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.128328] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.128527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.128527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.128759] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.128916] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.129090] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: e2888b20-a76e-489d-b64b-7bbe9bdbed95 is going to be created. [ 1618.147050] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.147591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.147591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.148528] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.148955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.149128] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.670411] env[71051]: INFO networking_nsxv3.common.synchronization [None req-efb1d1e0-0175-4ecb-b86e-2ac161dceb9c None None] Enqueued Resource ID: a81c7716-bf3c-45d1-8a09-26b0c6f6de16 with Priority: HIGHEST for action port [ 1618.670698] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81c7716-bf3c-45d1-8a09-26b0c6f6de16 with Priority: HIGHEST for action port [ 1618.672323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a81c7716-bf3c-45d1-8a09-26b0c6f6de16 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.672501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a81c7716-bf3c-45d1-8a09-26b0c6f6de16" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.672581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a81c7716-bf3c-45d1-8a09-26b0c6f6de16" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.672934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a81c7716-bf3c-45d1-8a09-26b0c6f6de16" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.673025] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81c7716-bf3c-45d1-8a09-26b0c6f6de16',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.872521] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-0ed22e9b-0b20-4ef5-aaaa-0c1640edcf6e service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1618.872521] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-0ed22e9b-0b20-4ef5-aaaa-0c1640edcf6e service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1618.872664] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-0ed22e9b-0b20-4ef5-aaaa-0c1640edcf6e service nova] Enqueued Resource ID: e2888b20-a76e-489d-b64b-7bbe9bdbed95 with Priority: HIGHEST for action port [ 1618.872897] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1618.873035] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1618.873143] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2888b20-a76e-489d-b64b-7bbe9bdbed95 with Priority: HIGHEST for action port [ 1618.874476] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.874610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.874694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.875079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.875184] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.877337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.877337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.877337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.877739] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.878559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2888b20-a76e-489d-b64b-7bbe9bdbed95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.878681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.878726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.880443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.880443] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2888b20-a76e-489d-b64b-7bbe9bdbed95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.112191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1619.112191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.118187] env[71051]: INFO networking_nsxv3.common.synchronization [req-68eef09c-60db-4316-86a5-b4f5b8c49cfe req-5054c3d5-162f-4d09-a390-a684754f5046 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1619.118791] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGHEST for action security_group_members [ 1619.119125] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.119335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.119335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.120055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.120055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.120055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.120055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.120315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.120557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.120639] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.178192] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a81c7716-bf3c-45d1-8a09-26b0c6f6de16 [ 1619.178501] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.182019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.182019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.182019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.182019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.182019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a81c7716-bf3c-45d1-8a09-26b0c6f6de16 already deleted. [ 1619.182019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a81c7716-bf3c-45d1-8a09-26b0c6f6de16" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.381070] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.381216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.381835] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.382759] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2888b20-a76e-489d-b64b-7bbe9bdbed95 with status ACTIVE [ 1619.382944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.383083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.383152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.386040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.386040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.386040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.386040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2888b20-a76e-489d-b64b-7bbe9bdbed95 is going to be updated. [ 1619.408031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.408031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.408031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.408031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.408031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.408356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2888b20-a76e-489d-b64b-7bbe9bdbed95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.623596] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.623746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.624632] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.624632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.625021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.625021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d is going to be updated. [ 1619.657023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.657023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.657023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.657023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.657023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.668049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: IN_PROGRESS for 2s [ 1619.760057] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-560 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.760536] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-560" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.760536] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-560" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.761263] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-560" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.761721] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.761976] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.762130] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.762504] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.762748] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.762939] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1619.763233] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1619.763381] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1619.763957] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1619.763957] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1619.763957] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1619.763957] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1619.782193] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1619.782429] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1619.782611] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1619.782794] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-560" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.783138] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-8e798276-03fc-4e34-86df-51cc40ff347f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.783362] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.783535] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.783853] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.783901] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e798276-03fc-4e34-86df-51cc40ff347f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.892802] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.904724] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.904724] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.904724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.904724] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1620.286540] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.286978] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.287286] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.288836] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 8e798276-03fc-4e34-86df-51cc40ff347f not found, creating... [ 1620.288836] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.288836] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.289716] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.289716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.289716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.289716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.292064] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.292064] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 8e798276-03fc-4e34-86df-51cc40ff347f is going to be created. [ 1620.310401] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.310635] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.310767] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.311037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.311512] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.311819] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.394575] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.394710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.394793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.395037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.395137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.395247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be created. [ 1620.412913] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.413103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.413173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.413384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.413578] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.413679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.413747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.413889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.413975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.414082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.414230] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.414322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.414376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.414519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.416204] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.416310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.416387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.416523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.416603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.416687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.416781] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1620.419548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.419690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.419834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.419888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.420009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.429657] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: UNINITIALIZED for 2s [ 1620.919431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49e506d-62f2-4518-a039-ac618500914a: rpc.has_security_group_logging(os_id): False [ 1620.937100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.937259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.937309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.937534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.937619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.937819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.937913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.938035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.938164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.938229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.938437] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.938535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.938602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.938736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.938811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.939041] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.939159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.939209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.939356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.939433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.939521] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be created. [ 1621.006837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.006978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.007070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.007304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.011020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.020655] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1621.062293] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-86408b75-d649-4476-be58-fd01d5b620f6 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1621.062656] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-86408b75-d649-4476-be58-fd01d5b620f6 service nova] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1621.062846] env[71051]: INFO networking_nsxv3.common.synchronization [req-52d249ab-a98e-4460-baa5-9e0e3eed53b1 req-86408b75-d649-4476-be58-fd01d5b620f6 service nova] Enqueued Resource ID: 8e798276-03fc-4e34-86df-51cc40ff347f with Priority: HIGHEST for action port [ 1621.063114] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_rules [ 1621.063261] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1621.063382] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e798276-03fc-4e34-86df-51cc40ff347f with Priority: HIGHEST for action port [ 1621.063933] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.064234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.064476] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.064574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.064756] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e798276-03fc-4e34-86df-51cc40ff347f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.064865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.064930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.065149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.065231] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e798276-03fc-4e34-86df-51cc40ff347f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.245157] env[71051]: INFO networking_nsxv3.common.synchronization [None req-07ff4e5e-3db5-46b9-9101-d283c017b82c None None] Enqueued Resource ID: 55efa44a-bfa6-403f-8f49-fe0c84247d94 with Priority: HIGHEST for action port [ 1621.245430] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55efa44a-bfa6-403f-8f49-fe0c84247d94 with Priority: HIGHEST for action port [ 1621.246137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-55efa44a-bfa6-403f-8f49-fe0c84247d94 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.246137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55efa44a-bfa6-403f-8f49-fe0c84247d94" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.246364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55efa44a-bfa6-403f-8f49-fe0c84247d94" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.246441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55efa44a-bfa6-403f-8f49-fe0c84247d94" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.246525] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55efa44a-bfa6-403f-8f49-fe0c84247d94',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.393363] env[71051]: INFO networking_nsxv3.common.synchronization [req-43b94178-402f-404c-82a6-efaec3883831 req-cec583b9-ad09-4f3e-b529-43c58841b260 tempest-DeleteServersAdminTestJSON-2104320323 tempest-DeleteServersAdminTestJSON-2104320323-project-member] Enqueued Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1621.393933] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2493d4-27de-4333-a7cd-5237d967e052 with Priority: HIGHEST for action security_group_members [ 1621.402029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2493d4-27de-4333-a7cd-5237d967e052 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.402029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.402029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.402029] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2493d4-27de-4333-a7cd-5237d967e052',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.568027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e798276-03fc-4e34-86df-51cc40ff347f with status ACTIVE [ 1621.568324] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.568324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.568324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.568641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.568745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.568932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.569068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.569138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.569565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.569565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.569565] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.569788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.569788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.569923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.570010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.570132] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e798276-03fc-4e34-86df-51cc40ff347f is going to be updated. [ 1621.591910] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.592055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.592055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.592382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.592474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.592695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e798276-03fc-4e34-86df-51cc40ff347f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.615022] env[71051]: INFO networking_nsxv3.common.synchronization [req-f49a1dba-bec2-47a7-96e7-5abe3644c613 req-f703c0af-690d-4d91-81a1-a0ca4d8a6167 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1621.616608] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1621.616608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.616608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.616608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.616608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.616608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.616608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.616982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.616982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.616982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.616982] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.681093] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d in Status: SUCCESS [ 1621.681712] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d deletion is rescheduled due to dependency. [ 1621.681712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.751909] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55efa44a-bfa6-403f-8f49-fe0c84247d94 [ 1621.752190] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.752328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.752412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.752640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.752729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.752824] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55efa44a-bfa6-403f-8f49-fe0c84247d94 already deleted. [ 1621.752905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55efa44a-bfa6-403f-8f49-fe0c84247d94" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.904031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.904031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.904031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.904031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.904294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.904332] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.904448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.904512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.904666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.904764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.904855] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 is going to be updated. [ 1621.930894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.933729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.933729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.933729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.933729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.940296] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: IN_PROGRESS for 2s [ 1621.949187] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.949187] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.949187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.949761] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1621.950124] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1621.950384] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1621.950611] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1621.950836] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1621.951053] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1621.951285] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1621.970020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1621.970020] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1621.970020] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1621.970020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.970020] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-0d810f22-111d-46a1-834d-a3f011629158 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.970020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.970020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.970020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.970020] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d810f22-111d-46a1-834d-a3f011629158',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1622.119729] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.119891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.119958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.120192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.120279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.120478] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.120575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.120629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.120790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.120867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.120975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc already deleted. [ 1622.121084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.442146] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.442146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.442146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.442146] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1622.443599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.443939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.445287] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.445287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.445287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.445287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.445287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.445287] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1622.475744] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.475744] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 0d810f22-111d-46a1-834d-a3f011629158 not found, creating... [ 1622.475744] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.475744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.476239] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.476239] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.476239] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.476239] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.478116] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.480536] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 0d810f22-111d-46a1-834d-a3f011629158 is going to be created. [ 1622.500565] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.500565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.500565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.500565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.500565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.500565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.944854] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.944854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.948293] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.040020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1623.040020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.241664] env[71051]: INFO networking_nsxv3.common.synchronization [req-f49a1dba-bec2-47a7-96e7-5abe3644c613 req-a3cbd2bc-4093-4296-8711-2addd24f6be8 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1623.243683] env[71051]: INFO networking_nsxv3.common.synchronization [req-f49a1dba-bec2-47a7-96e7-5abe3644c613 req-a3cbd2bc-4093-4296-8711-2addd24f6be8 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1623.243901] env[71051]: INFO networking_nsxv3.common.synchronization [req-f49a1dba-bec2-47a7-96e7-5abe3644c613 req-a3cbd2bc-4093-4296-8711-2addd24f6be8 service nova] Enqueued Resource ID: 0d810f22-111d-46a1-834d-a3f011629158 with Priority: HIGHEST for action port [ 1623.246191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1623.246191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1623.246191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d810f22-111d-46a1-834d-a3f011629158 with Priority: HIGHEST for action port [ 1623.246191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.246191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.246191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.246191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.246191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.249499] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.249619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.249687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.249887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.250055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.251021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.251021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.251021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.251021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.251021] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.251345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d810f22-111d-46a1-834d-a3f011629158 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.251485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.251526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.252072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.252072] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d810f22-111d-46a1-834d-a3f011629158',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.450245] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.749869] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.750016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.753522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.754464] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d810f22-111d-46a1-834d-a3f011629158 with status ACTIVE [ 1623.754671] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.754796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.754863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.755080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.755201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.755336] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.755480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.755528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.755694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.755775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.755994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.756077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.756124] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.756264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.756328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.756431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d810f22-111d-46a1-834d-a3f011629158 is going to be updated. [ 1623.782515] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.782692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.782927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.782927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.783229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.783229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d810f22-111d-46a1-834d-a3f011629158" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.952018] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2493d4-27de-4333-a7cd-5237d967e052 in Status: SUCCESS [ 1623.952459] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2493d4-27de-4333-a7cd-5237d967e052 deletion is rescheduled due to dependency. [ 1623.952459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2493d4-27de-4333-a7cd-5237d967e052" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.953826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.953826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.955323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.955578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.955708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.955894] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1623.983763] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.983983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.983983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.984667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.984667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.995716] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1624.260859] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.324709] env[71051]: INFO networking_nsxv3.common.synchronization [None req-907f26ed-48ed-45bc-9f3c-fd188ec463be None None] Enqueued Resource ID: 9ff6ee2e-b614-40bb-b3fc-afb8c6286a96 with Priority: HIGHEST for action port [ 1624.325443] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ff6ee2e-b614-40bb-b3fc-afb8c6286a96 with Priority: HIGHEST for action port [ 1624.325923] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ff6ee2e-b614-40bb-b3fc-afb8c6286a96 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.325923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ff6ee2e-b614-40bb-b3fc-afb8c6286a96" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.326078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ff6ee2e-b614-40bb-b3fc-afb8c6286a96" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.326209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ff6ee2e-b614-40bb-b3fc-afb8c6286a96" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.326309] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ff6ee2e-b614-40bb-b3fc-afb8c6286a96',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.767653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.767653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.767653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.767653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.767653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.767653] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be created. [ 1624.788269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.788269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.788269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.788269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.788269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.807484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: UNINITIALIZED for 2s [ 1624.832542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ff6ee2e-b614-40bb-b3fc-afb8c6286a96 [ 1624.832542] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.832542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.832542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.832542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.832542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.832542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ff6ee2e-b614-40bb-b3fc-afb8c6286a96 already deleted. [ 1624.832542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ff6ee2e-b614-40bb-b3fc-afb8c6286a96" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.007896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1626.008389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.008389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.008617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.008823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.008953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.009029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.009196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.009289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.009383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.009547] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.009639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.009697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.009945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.010041] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.010811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.010943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.011195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.011285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.011386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.011487] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1626.366732] env[71051]: INFO networking_nsxv3.common.synchronization [None req-0e4f1921-174a-4566-b712-d6bbe1a4b5a6 None None] Enqueued Resource ID: fd0734bc-2107-488c-8bfe-3b861d920d4b with Priority: HIGHEST for action port [ 1626.369893] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0734bc-2107-488c-8bfe-3b861d920d4b with Priority: HIGHEST for action port [ 1626.369893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd0734bc-2107-488c-8bfe-3b861d920d4b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.369893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd0734bc-2107-488c-8bfe-3b861d920d4b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.369893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd0734bc-2107-488c-8bfe-3b861d920d4b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.369893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd0734bc-2107-488c-8bfe-3b861d920d4b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.369893] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd0734bc-2107-488c-8bfe-3b861d920d4b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1626.515925] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b: rpc.has_security_group_logging(os_id): False [ 1626.537299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.537465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.537608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.537798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.537912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.538133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.538238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.538301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.538467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.538548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.538740] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.538838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.538901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.539169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.539169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.539309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.539402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.539465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.539604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.539679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.539763] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be created. [ 1626.592916] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.593084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.593159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.593391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.593794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.607242] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1626.821518] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1626.821518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.821755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.821888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.822129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.822250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.822335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.822530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.822633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.823093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.823208] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1626.871757] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd0734bc-2107-488c-8bfe-3b861d920d4b [ 1626.872366] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.872576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.872699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.873020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.873176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.873302] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd0734bc-2107-488c-8bfe-3b861d920d4b already deleted. [ 1626.873406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd0734bc-2107-488c-8bfe-3b861d920d4b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.903970] env[71051]: INFO networking_nsxv3.common.synchronization [req-f771e633-b5ba-423f-9cd8-575e8211f831 req-1cf00e59-a0a2-4915-b2ed-f9d83294b26e tempest-ListImageFiltersTestJSON-1814967747 tempest-ListImageFiltersTestJSON-1814967747-project-member] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1626.905229] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1626.905591] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.905774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.905812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.906067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.906404] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1626.906404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1626.907242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1626.907369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1626.907485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.907595] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1627.214682] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.215143] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.215143] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.215559] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.215906] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.216117] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.216318] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.216721] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.216938] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.217293] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1627.217461] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1627.217641] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1627.218396] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1627.218644] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1627.218913] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1627.219062] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1627.240017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1627.240208] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1627.240353] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1627.240652] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.240975] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ef526551-b8b1-49aa-a428-8a76f48c63de taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.241174] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.241298] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.241639] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.241820] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef526551-b8b1-49aa-a428-8a76f48c63de',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1627.327212] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.327390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.327459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.328148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.328148] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.328148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.328148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.328148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.328419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.328419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.328491] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.329217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.329217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.329564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.329564] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1627.415032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.415032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.415032] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 already deleted. [ 1627.415032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.744197] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.744441] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.744578] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.744883] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.745060] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.745225] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ef526551-b8b1-49aa-a428-8a76f48c63de not found, creating... [ 1627.745492] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.745772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.746104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.746180] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.746758] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.746758] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.746758] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.747018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.747186] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.747329] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.747470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ef526551-b8b1-49aa-a428-8a76f48c63de is going to be created. [ 1627.766156] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.766361] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.766495] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.766757] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.766985] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.767233] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.831431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1627.849309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.849462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.849522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.849709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.849810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.850012] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.850139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.850210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.850390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.850476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.850666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.850764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.850826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.850970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.851058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.851234] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.851328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.851390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.851531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.851608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.851695] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be created. [ 1627.947778] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.947778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1627.947778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1627.947973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1627.948128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1627.959770] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [req-f771e633-b5ba-423f-9cd8-575e8211f831 req-e4c61400-269a-4b0a-9def-c893bf685ba1 service nova] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_rules [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [req-f771e633-b5ba-423f-9cd8-575e8211f831 req-e4c61400-269a-4b0a-9def-c893bf685ba1 service nova] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [req-f771e633-b5ba-423f-9cd8-575e8211f831 req-e4c61400-269a-4b0a-9def-c893bf685ba1 service nova] Enqueued Resource ID: ef526551-b8b1-49aa-a428-8a76f48c63de with Priority: HIGHEST for action port [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_rules [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1628.452022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef526551-b8b1-49aa-a428-8a76f48c63de with Priority: HIGHEST for action port [ 1628.452514] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.452580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.452625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.452854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.452975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.454388] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.454477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.454525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.454659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.454823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.454914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.454988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.455173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.455260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.455374] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.456551] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef526551-b8b1-49aa-a428-8a76f48c63de taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.456658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.456714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.456967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.457089] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef526551-b8b1-49aa-a428-8a76f48c63de',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.622609] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1628.622966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.623191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.623538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.623664] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.955714] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.956739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.957251] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.959779] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef526551-b8b1-49aa-a428-8a76f48c63de with status ACTIVE [ 1628.959779] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.959779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.959779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.959779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.959779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.960030] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.960030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.960030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.960286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.960351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.960618] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.960707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.960707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.960894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.960937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.961036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef526551-b8b1-49aa-a428-8a76f48c63de is going to be updated. [ 1628.982464] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.982464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.982464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.982464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.982464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.982464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef526551-b8b1-49aa-a428-8a76f48c63de" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.126196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.126394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.126463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.126685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.126862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.126963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.127038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.127190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.127278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.127366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.127461] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.461898] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.632475] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.632694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.632768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.632991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.633246] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.633300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.633375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.633542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.633632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.633715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.633883] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.633976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.634038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.634178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.634309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.634396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.634460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.635695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.635695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.635695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.635695] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.963918] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.964096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.964170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.964383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.964475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.964576] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be created. [ 1629.971735] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1629.971952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.984714] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.984714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.984714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.985187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.985807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.993681] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: UNINITIALIZED for 2s [ 1630.141032] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b: rpc.has_security_group_logging(os_id): False [ 1630.157120] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.157285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.157353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.157565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.157654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.157848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.157939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.158098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.158721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.158721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.158721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.158721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.158721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.158721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.158987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.158987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.159628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.159771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.159974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.160221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.160566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1630.256816] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.256974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.257057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.257282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.257421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.273529] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1631.871662] env[71051]: INFO networking_nsxv3.common.synchronization [req-930d0670-5fda-4044-8c87-ebe3afe71356 req-a3fc61d5-7ecb-45a0-87ce-48b4a6ab1c80 tempest-ListImageFiltersTestJSON-1814967747 tempest-ListImageFiltersTestJSON-1814967747-project-member] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1631.872227] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1631.872644] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.872753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.003627] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1632.003854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.004477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.004722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.004965] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.005659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.005659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.005659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.005806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.005842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.005942] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.007367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.007367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.007367] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.007367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.007367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.007582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.007582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.007652] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.285912] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.285912] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.285912] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.286169] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.286356] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.286553] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.286681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.286912] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.287183] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.287767] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1632.287767] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1632.287976] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1632.287976] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1632.289027] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1632.289027] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1632.289027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1632.290586] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1632.290710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.306883] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1632.307044] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1632.307226] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1632.307367] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-909" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.307682] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-863bc4d3-cf3f-4751-9d08-d3125cf45f95 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.307860] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.308023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.308365] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.308519] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('863bc4d3-cf3f-4751-9d08-d3125cf45f95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.510229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.510487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.510611] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.813548] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.815899] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.815899] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.816051] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.816249] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.816416] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 863bc4d3-cf3f-4751-9d08-d3125cf45f95 not found, creating... [ 1632.816706] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.816883] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.817016] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.817281] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.817430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.817745] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.817908] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.818037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.818293] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.818454] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.818640] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 863bc4d3-cf3f-4751-9d08-d3125cf45f95 is going to be created. [ 1632.840315] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.840315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.840315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.840315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.840315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.840315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.014325] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1633.516811] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.517178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.517178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.517440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.517440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.517556] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be updated. [ 1633.549024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.549024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.549024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.549024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.549024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.558638] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [req-930d0670-5fda-4044-8c87-ebe3afe71356 req-8632e68b-1713-4413-8ab7-7e129a7594cb service nova] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_rules [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [req-930d0670-5fda-4044-8c87-ebe3afe71356 req-8632e68b-1713-4413-8ab7-7e129a7594cb service nova] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [req-930d0670-5fda-4044-8c87-ebe3afe71356 req-8632e68b-1713-4413-8ab7-7e129a7594cb service nova] Enqueued Resource ID: 863bc4d3-cf3f-4751-9d08-d3125cf45f95 with Priority: HIGHEST for action port [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_rules [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1633.588025] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 863bc4d3-cf3f-4751-9d08-d3125cf45f95 with Priority: HIGHEST for action port [ 1633.588025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.588025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.589175] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.589414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.589714] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-863bc4d3-cf3f-4751-9d08-d3125cf45f95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.589961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.590224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.590571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.591733] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('863bc4d3-cf3f-4751-9d08-d3125cf45f95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.039905] env[71051]: INFO networking_nsxv3.common.synchronization [req-7bf574e4-3315-4c80-b7d2-343e403f230f req-c3991a71-cd3f-4653-aa21-56d9b6b8fcbe tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1634.040485] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1634.040798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.040939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.041241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.041506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.044271] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.044271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.044271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.044271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.044271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.044271] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.092752] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 863bc4d3-cf3f-4751-9d08-d3125cf45f95 with status ACTIVE [ 1634.093061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.095017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.095017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.095017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.095017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 863bc4d3-cf3f-4751-9d08-d3125cf45f95 is going to be updated. [ 1634.115444] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.115588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.115702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.115868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.116013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.116177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-863bc4d3-cf3f-4751-9d08-d3125cf45f95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.401253] env[71051]: INFO networking_nsxv3.common.synchronization [None req-5247a59f-16b9-4a3d-9034-4e664078fb6b None None] Enqueued Resource ID: 29998d27-4763-4a73-85be-5b7ebd85a21d with Priority: HIGHEST for action port [ 1634.401652] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29998d27-4763-4a73-85be-5b7ebd85a21d with Priority: HIGHEST for action port [ 1634.402633] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-29998d27-4763-4a73-85be-5b7ebd85a21d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.403210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29998d27-4763-4a73-85be-5b7ebd85a21d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.403210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29998d27-4763-4a73-85be-5b7ebd85a21d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.403210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29998d27-4763-4a73-85be-5b7ebd85a21d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.403210] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29998d27-4763-4a73-85be-5b7ebd85a21d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.461661] env[71051]: INFO networking_nsxv3.common.synchronization [req-7bf574e4-3315-4c80-b7d2-343e403f230f req-37e37182-73f1-4fee-b255-d96044772a2d tempest-ServersTestMultiNic-1727990506 tempest-ServersTestMultiNic-1727990506-project-member] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1634.462205] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGHEST for action security_group_members [ 1634.462558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.462669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.549239] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.908426] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29998d27-4763-4a73-85be-5b7ebd85a21d [ 1634.908787] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.908902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.908902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.909116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.909211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.909311] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29998d27-4763-4a73-85be-5b7ebd85a21d already deleted. [ 1634.909392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29998d27-4763-4a73-85be-5b7ebd85a21d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.052008] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.512031] env[71051]: INFO networking_nsxv3.common.synchronization [None req-cd814b54-2b5b-489f-b05b-f0992de0d2f5 tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1635.512031] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1635.512031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.512031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.512031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.512031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.512031] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.555147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.555305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.555379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.555587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.555685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.555872] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1635.579933] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 4s [ 1635.615441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.615592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.616192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.616505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.616757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.626413] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1635.634570] env[71051]: INFO networking_nsxv3.common.synchronization [None req-b373db65-0270-461e-b31f-408a498be90e tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1635.634570] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1635.634875] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.635027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.035172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.036012] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 already deleted. [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.036362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.036362] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.445117] env[71051]: INFO networking_nsxv3.common.synchronization [None req-79f7172e-905e-4267-8105-f6fc87ceac88 None None] Enqueued Resource ID: 75c324fc-3756-49bd-9dda-43129880039a with Priority: HIGHEST for action port [ 1636.445117] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c324fc-3756-49bd-9dda-43129880039a with Priority: HIGHEST for action port [ 1636.445117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-75c324fc-3756-49bd-9dda-43129880039a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.445117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75c324fc-3756-49bd-9dda-43129880039a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.445117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75c324fc-3756-49bd-9dda-43129880039a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.445117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75c324fc-3756-49bd-9dda-43129880039a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.445560] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c324fc-3756-49bd-9dda-43129880039a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.558344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.558554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.558642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.559167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.559310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.559524] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 already deleted. [ 1636.559691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.948509] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75c324fc-3756-49bd-9dda-43129880039a [ 1636.948711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.948836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.948903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.949188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.949293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.949387] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75c324fc-3756-49bd-9dda-43129880039a already deleted. [ 1636.949467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75c324fc-3756-49bd-9dda-43129880039a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.593021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.593021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.593021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.593021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.593681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.593681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.593681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.593681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.593681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.593681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.593842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.593842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.593842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.596975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.596975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.596975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.596975] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1637.638754] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1637.639407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.639540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.639778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.639970] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.640102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.640168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.640323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.640558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.640558] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1638.099093] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1638.100111] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0dc22fb-5e65-4d6f-8add-5ec49f4d0051: rpc.has_security_group_logging(os_id): False [ 1638.116821] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.117024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.117075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.118966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.119116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.119377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.119506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.119555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.119735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.119826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.120047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.120154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.120211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.120363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.120502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.120630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.120726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.120788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.120931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.121016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.121127] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be created. [ 1638.142630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.142789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.142867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.143081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.143171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.143382] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.143500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.143571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.143732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.143809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.143900] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be updated. [ 1638.165289] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.165518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.165518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.165799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.165971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.175379] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: IN_PROGRESS for 2s [ 1638.194109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.194109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.194227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.194354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.194535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.203906] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1638.602297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1639.106043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1639.106043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1639.106043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.106043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.106325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.106325] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be updated. [ 1639.132711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1639.132819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1639.132884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.133107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.133253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.142338] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1640.184497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b in Status: SUCCESS [ 1640.184815] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b deletion is rescheduled due to dependency. [ 1640.184815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.217161] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1640.217481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.217612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.217925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.217925] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1640.720410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.720596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.156152] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1641.156748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.156748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.156748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.157084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1641.157084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.157176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.157307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.157358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.157427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.157513] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1641.445191] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.445461] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1641.659859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1641.660021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.660073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.660289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.660461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1641.660603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.660603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.660755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.660844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.660932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.661125] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1641.661219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.661279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.661424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.661561] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1641.661649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1641.661707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1641.661843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1641.661918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.661998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1641.662104] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1642.165134] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0dc22fb-5e65-4d6f-8add-5ec49f4d0051: rpc.has_security_group_logging(os_id): False [ 1642.182092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.182253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.183171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.183171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.183403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.183403] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.183832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.183832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.183832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.183832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.183964] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.184076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.184127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.184264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.184339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.184424] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be updated. [ 1642.246976] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.246976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.246976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.246976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.247267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.261426] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1642.549727] env[71051]: INFO networking_nsxv3.common.synchronization [req-1995dd64-58eb-4320-839c-43603b8e1957 req-51e54055-b304-4399-be04-46f151f9bef0 tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1642.550791] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1642.551178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.552407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.552565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.552833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.553059] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1642.553239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1642.553318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1642.553517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1642.553628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1642.553735] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1643.057222] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1643.338122] env[71051]: INFO networking_nsxv3.common.synchronization [req-2e3319be-622b-4e91-8fc2-005cbd56c40e req-575f8ec8-a391-4bc9-9b20-19b0edb21190 tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1643.338655] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1643.338945] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.339070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.339132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.339375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.339528] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.339627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.339685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.339832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.339912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1643.340008] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1643.565450] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1643.842824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.842921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.842987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.843183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.843281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1643.843486] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.843583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.843661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.843823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.843903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1643.843994] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 already deleted. [ 1643.844085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.068186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.068396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.068474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.068694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.068790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.068885] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1644.098302] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.098302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.098302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.098302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.098302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.104161] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1644.163306] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.163306] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.163306] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.163522] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.163827] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.164048] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.164208] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.164517] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.164715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.164999] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1644.165195] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1644.165354] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1644.165514] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1644.165677] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1644.165836] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1644.166079] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1644.187341] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1644.187574] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1644.187779] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1644.187999] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-362" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.189129] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-63f858be-aae1-4abb-a338-9cb7e680bee3 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.189395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.189573] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.190034] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.190237] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f858be-aae1-4abb-a338-9cb7e680bee3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1644.274349] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1644.274586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.693468] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.693468] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.693966] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.694710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.694895] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.695069] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 63f858be-aae1-4abb-a338-9cb7e680bee3 not found, creating... [ 1644.695514] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.695699] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.695825] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.696089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.696500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.696578] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.696697] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.696822] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.697233] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.697233] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.697371] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 63f858be-aae1-4abb-a338-9cb7e680bee3 is going to be created. [ 1644.727988] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.727988] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.727988] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.728313] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.728603] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.728909] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1645.494169] env[71051]: INFO networking_nsxv3.common.synchronization [req-2e3319be-622b-4e91-8fc2-005cbd56c40e req-f038d983-7727-4b7a-8021-0f6972a16441 service nova] Enqueued Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_rules [ 1645.494169] env[71051]: INFO networking_nsxv3.common.synchronization [req-2e3319be-622b-4e91-8fc2-005cbd56c40e req-f038d983-7727-4b7a-8021-0f6972a16441 service nova] Enqueued Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1645.494169] env[71051]: INFO networking_nsxv3.common.synchronization [req-2e3319be-622b-4e91-8fc2-005cbd56c40e req-f038d983-7727-4b7a-8021-0f6972a16441 service nova] Enqueued Resource ID: 63f858be-aae1-4abb-a338-9cb7e680bee3 with Priority: HIGHEST for action port [ 1645.494573] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_rules [ 1645.494573] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1645.494821] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63f858be-aae1-4abb-a338-9cb7e680bee3 with Priority: HIGHEST for action port [ 1645.496431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.499065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.499065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.499065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.499065] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1645.499673] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.500447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.500447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.501117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.501360] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.502260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.502404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.507437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.507437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1645.507536] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1645.508418] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-63f858be-aae1-4abb-a338-9cb7e680bee3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.508535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.508604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.508776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.508859] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f858be-aae1-4abb-a338-9cb7e680bee3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1646.003442] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.003442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.012922] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1646.015244] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63f858be-aae1-4abb-a338-9cb7e680bee3 with status ACTIVE [ 1646.016491] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.017845] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.017845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.018098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.018213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.018465] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.018619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.018715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.018872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.018957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.019053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63f858be-aae1-4abb-a338-9cb7e680bee3 is going to be updated. [ 1646.042207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.042369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.042441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.042709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.042853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.043033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63f858be-aae1-4abb-a338-9cb7e680bee3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.117397] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1646.117622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.521404] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1647.024870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.024870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.024870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.024870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.025235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.025235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 is going to be created. [ 1647.049920] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.050106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.050166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.050368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.050634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.059262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: UNINITIALIZED for 2s [ 1648.352247] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a4868b1-fe69-4b80-b354-24a5969cdf5c req-d2ecdcc9-0565-4fb6-a39c-c20243d86a5f tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1648.352247] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1648.353285] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.353534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.353749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.354056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.354398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.354631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.354788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.355064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.355240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1648.355407] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1648.857625] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1648.912304] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.912525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.912676] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.912955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.913233] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.913398] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.913542] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.913799] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.913910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1648.914163] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1648.914252] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1648.914384] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1648.914546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1648.914670] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1648.914670] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1648.914808] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1648.932999] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1648.933206] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1648.933349] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1648.933528] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1648.933839] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.934027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.934158] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.934492] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.934637] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e50206-f3ca-4ccf-ae44-be2c83f2c05d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.068360] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: SUCCESS [ 1649.068360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.068541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.068848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.069081] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.069230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.069300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.069496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.069588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.069698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.069800] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.362945] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.436964] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.437462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.437621] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.438039] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.438265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.438496] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 85e50206-f3ca-4ccf-ae44-be2c83f2c05d not found, creating... [ 1649.438876] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.438978] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.439168] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.439486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.439616] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.439939] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.440162] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.440316] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.440586] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.440783] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.440963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 85e50206-f3ca-4ccf-ae44-be2c83f2c05d is going to be created. [ 1649.458838] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.459075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.459237] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.459495] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.459737] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.459955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.572524] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.572524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.572524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.572524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.572741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.573136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.573136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.573136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.573136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.573293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.573388] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.573764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.573764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.573891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.573958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.574121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.574189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.574392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.574488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.574574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.574666] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.866938] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.866938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.866938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.866938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.866938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.866938] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1649.894696] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1649.894897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1649.894958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1649.895160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1649.895309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.905976] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1650.078407] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59b1387f-82fc-4ceb-9ccc-ab09d9384c95: rpc.has_security_group_logging(os_id): False [ 1650.095392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.095596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.095596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.095717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.095810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.096294] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.096294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.096294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.096469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.096469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.096597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.096723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.096765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.096887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.096961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.097148] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.097242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.097305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.097446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.097520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.097606] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 is going to be created. [ 1650.127377] env[71051]: INFO networking_nsxv3.common.synchronization [req-a42882c1-8a57-441d-bcde-2dfe1f378419 req-bf01d3ac-6dfe-43d9-923e-6d6b1d6340d4 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1650.128267] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1650.128267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.128475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.128475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.128567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.128712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.128801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.128861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.129014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.129101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.129239] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.150337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.150664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.150827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.151200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.151605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.162109] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: IN_PROGRESS for 2s [ 1650.630982] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.631279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.631279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.631336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.632767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.632881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.632990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.633065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.633248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.633324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.633408] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1650.666067] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.666067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.666067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.666067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.666067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.677127] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1650.678798] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a4868b1-fe69-4b80-b354-24a5969cdf5c req-042d7710-579e-4540-858a-eaa8ea4f0fe5 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1650.679226] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a4868b1-fe69-4b80-b354-24a5969cdf5c req-042d7710-579e-4540-858a-eaa8ea4f0fe5 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1650.679367] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a4868b1-fe69-4b80-b354-24a5969cdf5c req-042d7710-579e-4540-858a-eaa8ea4f0fe5 service nova] Enqueued Resource ID: 85e50206-f3ca-4ccf-ae44-be2c83f2c05d with Priority: HIGHEST for action port [ 1650.679597] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1650.679771] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1650.679825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e50206-f3ca-4ccf-ae44-be2c83f2c05d with Priority: HIGHEST for action port [ 1650.680371] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.680510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.680585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.680788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.680858] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.681890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.681990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.682203] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.682302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.682366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.682525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.682629] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e50206-f3ca-4ccf-ae44-be2c83f2c05d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.864819] env[71051]: INFO networking_nsxv3.common.synchronization [req-4f5990e4-a133-4aab-881e-d55530ae00ac req-5328957b-bbdb-426a-a29f-d7fdd903d0b8 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1650.864819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1650.864998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.864998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.865094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.865278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.865434] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.865537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.865598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.865742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.865828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.865924] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.171405] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.171627] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.171848] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.172165] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.172518] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.172728] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.172852] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.173146] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.173305] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.173551] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1651.173708] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1651.173829] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1651.173939] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1651.174066] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1651.174174] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1651.174309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1651.184368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.184494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.184641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85e50206-f3ca-4ccf-ae44-be2c83f2c05d with status ACTIVE [ 1651.184793] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.184891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.184952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.185163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.185244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.185410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.185496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.185553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.185689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.185761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.185945] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.186033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.186080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.186773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.186773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.186773] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85e50206-f3ca-4ccf-ae44-be2c83f2c05d is going to be updated. [ 1651.196044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1651.196044] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1651.196183] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1651.196331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.196642] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-49067231-d739-4134-92ae-dfe88e7a2079 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.196815] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.196939] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.197270] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.197418] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49067231-d739-4134-92ae-dfe88e7a2079',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.204989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.205130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.205201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.205376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.205505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.205656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e50206-f3ca-4ccf-ae44-be2c83f2c05d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.368171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.368345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.368465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.368891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.389287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.389548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.389672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.389737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.389937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.390032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.390119] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1651.414305] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.414453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.414525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.414772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.414946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.422580] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1651.700087] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.700629] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.700629] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.700780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.700893] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.701081] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 49067231-d739-4134-92ae-dfe88e7a2079 not found, creating... [ 1651.701373] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.701541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.701663] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.701942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.702147] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.702586] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.702779] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.702939] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.703275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.703509] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.703715] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 49067231-d739-4134-92ae-dfe88e7a2079 is going to be created. [ 1651.723445] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.723727] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.724025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.724318] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.724665] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.724928] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.915428] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1651.915679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.915853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.916117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.916263] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.916377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.916441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.916606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.916730] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.916834] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.175588] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: SUCCESS [ 1652.176650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.420386] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.448984] env[71051]: INFO networking_nsxv3.common.synchronization [req-4f5990e4-a133-4aab-881e-d55530ae00ac req-d8352220-b076-4c62-a2ca-6ec6d543b556 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1652.449204] env[71051]: INFO networking_nsxv3.common.synchronization [req-4f5990e4-a133-4aab-881e-d55530ae00ac req-d8352220-b076-4c62-a2ca-6ec6d543b556 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1652.449347] env[71051]: INFO networking_nsxv3.common.synchronization [req-4f5990e4-a133-4aab-881e-d55530ae00ac req-d8352220-b076-4c62-a2ca-6ec6d543b556 service nova] Enqueued Resource ID: 49067231-d739-4134-92ae-dfe88e7a2079 with Priority: HIGHEST for action port [ 1652.449572] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1652.449700] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1652.449796] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49067231-d739-4134-92ae-dfe88e7a2079 with Priority: HIGHEST for action port [ 1652.450316] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.450472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.450500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.450729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.450843] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.452012] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.452111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.452935] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-49067231-d739-4134-92ae-dfe88e7a2079 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.452935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.452935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.452935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.452935] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49067231-d739-4134-92ae-dfe88e7a2079',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.688665] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1652.689289] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1652.689289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.922423] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.953970] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.954141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.954309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49067231-d739-4134-92ae-dfe88e7a2079 with status ACTIVE [ 1652.954483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.954597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.954665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.954885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.954992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.955177] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.955275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.955338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.955496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.955575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.955832] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.955832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.955952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.956037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.956113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.956206] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49067231-d739-4134-92ae-dfe88e7a2079 is going to be updated. [ 1652.975861] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.976027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.976066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.976265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.976396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.976561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49067231-d739-4134-92ae-dfe88e7a2079" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.424890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.426059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.426194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.426411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.426507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.426611] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1653.435874] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1653.436062] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1653.436185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.436358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.436568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.437189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.437189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.437189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.437425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.437425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.437503] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.451712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.451837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.451875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.452081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.452226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.461070] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1653.939399] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.443415] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.948600] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.948600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.948600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.948600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.948600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.948600] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1654.973382] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.973534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.973607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.973829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.973974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.982462] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1655.183457] env[71051]: INFO networking_nsxv3.common.synchronization [req-57ce5c61-ae95-4082-8d99-20364fa190ca req-7c60a265-bbee-4cf5-a2fb-f7f06f7bdcd2 tempest-ServersWithSpecificFlavorTestJSON-2113755599 tempest-ServersWithSpecificFlavorTestJSON-2113755599-project-member] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1655.184158] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGHEST for action security_group_members [ 1655.184827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.184950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.185047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.185254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.185410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.185519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.185603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.185703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.185819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.185937] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.470947] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1655.471196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.471367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.471590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.471788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.471911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.471976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.472150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.472231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.472316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.472409] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.691033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.691033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.691033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.691033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27aac1-26b8-4e44-9313-936316b62525 is going to be updated. [ 1655.714898] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.715105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.715175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.715352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.715487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.723346] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: IN_PROGRESS for 2s [ 1655.977907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.977907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.977907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.977907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.977907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.978744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.978744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.978744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.978744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.978744] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.130519] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-1e11b3e0-c244-4bab-a006-8eb30b0504dd tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1656.131103] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1656.131421] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.131543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.131610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.132018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.132092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.132148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.132204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.132363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.132447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.132543] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.483276] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1656.497981] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.498151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.498681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.498942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.499045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.499269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.499365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.499424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.501159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.501159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.501159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.501159] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1656.557885] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.558034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.558093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.558349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.558522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.573411] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1656.612544] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.612859] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.613024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.613528] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.613829] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.614185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.614347] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.614654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.614875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.615217] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1656.615412] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1656.615572] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1656.615725] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1656.615894] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1656.616068] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1656.616260] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1656.634445] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.634445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.634445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.634666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.634666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.635073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.635073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.635073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.635258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.635299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.635383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af already deleted. [ 1656.635485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.652345] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1656.652541] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1656.652696] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1656.652904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.653242] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-b4f199d8-d6e9-4683-9727-3c96e3ab9443 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.653422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.653547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.653884] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.654063] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f199d8-d6e9-4683-9727-3c96e3ab9443',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.992910] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1656.993203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.994079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.994079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.994079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.994079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.994079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.994413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.994413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.994413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.994554] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.156538] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.156952] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.156952] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.157219] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.157378] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.157542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port b4f199d8-d6e9-4683-9727-3c96e3ab9443 not found, creating... [ 1657.157809] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.158087] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.158152] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.158341] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.158485] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.158772] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.158936] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.159069] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.159294] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.159430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.159584] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: b4f199d8-d6e9-4683-9727-3c96e3ab9443 is going to be created. [ 1657.177420] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.177641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.177774] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.178101] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.178338] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.178575] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.497312] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.497490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.497562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.497801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.497988] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.498112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.498176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.498576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.498576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.498576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.498749] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.498843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.498920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.499094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.499236] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.499332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.499412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.499583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.499679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.499751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.499830] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.734406] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27aac1-26b8-4e44-9313-936316b62525 in Status: SUCCESS [ 1657.734583] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27aac1-26b8-4e44-9313-936316b62525 deletion is rescheduled due to dependency. [ 1657.734740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.002487] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1658.019948] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.020148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.020209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.020597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.020732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.021023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.021082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.021184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.021309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.021388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.021567] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.021663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.021722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.021992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.021992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.022247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.022346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.022398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.022542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.022680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.022796] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1658.052902] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-c08180ce-11ce-47d8-a91d-c3f9a7c184ad service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1658.053120] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-c08180ce-11ce-47d8-a91d-c3f9a7c184ad service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1658.053293] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-c08180ce-11ce-47d8-a91d-c3f9a7c184ad service nova] Enqueued Resource ID: b4f199d8-d6e9-4683-9727-3c96e3ab9443 with Priority: HIGHEST for action port [ 1658.053851] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1658.053991] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1658.054246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4f199d8-d6e9-4683-9727-3c96e3ab9443 with Priority: HIGHEST for action port [ 1658.054552] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.055371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.055371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.055371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.055371] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1658.055961] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.056089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.056447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.056447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.056547] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.056547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.056707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.056794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.056931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.056992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1658.057824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4f199d8-d6e9-4683-9727-3c96e3ab9443 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.057932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.057998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.058189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.058262] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f199d8-d6e9-4683-9727-3c96e3ab9443',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1658.077279] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.077419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.077491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.077700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.077844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.092017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1658.559996] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.560925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.560925] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1658.561341] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4f199d8-d6e9-4683-9727-3c96e3ab9443 with status ACTIVE [ 1658.561507] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.562011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.562011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.562011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.562011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.562188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.562293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.562327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.565038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.565038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.565038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4f199d8-d6e9-4683-9727-3c96e3ab9443 is going to be updated. [ 1658.591134] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1658.591366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.593982] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.594412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.594793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.595573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.595573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.595573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4f199d8-d6e9-4683-9727-3c96e3ab9443" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.632787] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-b25357aa-e49b-43e9-aaee-c4190fc59d7e tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1658.633516] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1658.633788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.634474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.990194] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.990408] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.990541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.990879] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.991173] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.991339] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.991463] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.991694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.991848] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.992071] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1658.992191] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1658.992306] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1658.992418] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1658.992533] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1658.992682] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1658.992873] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1659.012208] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1659.012511] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1659.012658] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1659.012766] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.013128] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.013310] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.013435] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.013801] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.013990] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dec5fd-47f1-4fe5-9d7a-5320418e8d68',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1659.066879] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1659.516983] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.517298] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.517397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.517639] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.517796] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.517957] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 not found, creating... [ 1659.518275] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.518548] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.518548] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.518805] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.518920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.519243] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.519431] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.519518] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.519723] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.519859] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.520010] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 is going to be created. [ 1659.538655] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.538890] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.539298] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.539298] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.539529] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.539982] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.569538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.569766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.569766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.570027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.570027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.570145] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be created. [ 1659.591408] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1659.591590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1659.591650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1659.591865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1659.592035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.605878] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: UNINITIALIZED for 2s [ 1660.103474] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1660.103783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1660.530550] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-d987e1a5-ee61-4378-9bc1-3ae37cf21337 service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1660.530748] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-d987e1a5-ee61-4378-9bc1-3ae37cf21337 service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1660.530889] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-d987e1a5-ee61-4378-9bc1-3ae37cf21337 service nova] Enqueued Resource ID: 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 with Priority: HIGHEST for action port [ 1660.531558] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1660.531707] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1660.531865] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 with Priority: HIGHEST for action port [ 1660.532292] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1660.532400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1660.533256] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1660.533256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1660.533256] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1660.533256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1660.533887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1660.533887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1660.533887] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dec5fd-47f1-4fe5-9d7a-5320418e8d68',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1660.637351] env[71051]: INFO networking_nsxv3.common.synchronization [req-160d18a6-f405-4170-8289-1bbcae333745 req-186fbdae-68cb-4e41-8694-d4e8168b1d6c tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1660.638469] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGHEST for action security_group_members [ 1660.638469] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1660.638469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1660.638469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1660.638778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1660.638818] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1660.638934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1660.638984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1660.639139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1660.639250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1660.639348] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1661.036738] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 with status ACTIVE [ 1661.036979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.037165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.037165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.037388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.037487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.037670] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.037761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.037818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.037981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.038081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.038264] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.038370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.038431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.038558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.038624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.038711] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55dec5fd-47f1-4fe5-9d7a-5320418e8d68 is going to be updated. [ 1661.071259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.071419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.071477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.071687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.071828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.071996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55dec5fd-47f1-4fe5-9d7a-5320418e8d68" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.141639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.142218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.142218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.142218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.142399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.142465] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.142559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.142697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.142871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.142955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.143057] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 is going to be updated. [ 1661.175643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.175643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.175643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.175880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.175945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.183739] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: IN_PROGRESS for 2s [ 1661.569334] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1527a0b3-86c7-4172-9fed-448fa0f97dc3 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1661.569334] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1661.569459] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.569530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.569591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.570724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.570724] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1661.615833] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1661.616071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.616537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.616789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.616990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.617125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.617192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.617351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.617434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.617525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.617613] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1661.618479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.618647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.622265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.622399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1661.622466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1661.622651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1661.622751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.622851] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1661.670793] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4820eb09-b0f2-48cb-b0e2-a5a592cacecc tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1661.672522] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1661.672522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1661.672522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1662.093474] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1662.093474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1662.093665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1662.093908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1662.094066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1662.094210] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a already deleted. [ 1662.094342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1662.095339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1662.095339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1662.095339] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1662.125252] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1662.126261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1662.127249] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1662.616068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1662.616346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1662.616474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1662.616591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1662.616685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1662.616782] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a already deleted. [ 1662.616863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1662.628398] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1663.131462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1663.131657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1663.131794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1663.132155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1663.132300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1663.132474] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1663.167865] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1663.168061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1663.168061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1663.168283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1663.168482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1663.176979] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1663.191962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 in Status: SUCCESS [ 1663.192145] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 deletion is rescheduled due to dependency. [ 1663.192260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1663.569406] env[71051]: INFO networking_nsxv3.common.synchronization [req-78b66e43-ab0d-4a1a-9dc5-bd0bc8b2033f req-8b43ea07-4ea2-4b33-a0a7-e56db2ba0f3c tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1663.570034] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1663.571649] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1663.571830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1663.571905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1663.572176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1663.572355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1663.572503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1663.572571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1663.572770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1663.572884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1663.573034] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1664.076446] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1664.579423] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1665.082757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1665.083060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1665.083104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1665.083342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1665.083461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1665.083566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1665.109014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1665.109305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1665.109382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1665.109590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1665.109734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1665.118086] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1665.185098] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1665.185332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1665.185501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1665.185723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1665.185919] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1665.186047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1665.186123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1665.186290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1665.186375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1665.186469] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1665.689090] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1666.191434] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1666.663750] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-2669ebdb-b93d-44ed-93ba-e3da43411394 tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1666.664534] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1666.665080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1666.665275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1666.693979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1666.694194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1666.694258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1666.694453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1666.694545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1666.694645] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1666.721009] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1666.721009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1666.721009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1666.721009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1666.721177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1666.730319] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1667.092635] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.093454] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.093695] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.093918] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.094213] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.094476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.094536] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.094715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.094891] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.098257] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1667.098345] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1667.098559] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1667.098559] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1667.098713] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1667.098766] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1667.098910] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1667.118363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1667.118363] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1667.118363] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1667.118363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-172" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.118786] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-852e3e3d-b57f-4864-b82b-885c1705fad1 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.118786] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.118923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.119232] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.119382] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852e3e3d-b57f-4864-b82b-885c1705fad1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1667.128827] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1667.128827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.237318] env[71051]: INFO networking_nsxv3.common.synchronization [None req-961a11d6-514e-4e36-8dad-aaf2d681b116 None None] Enqueued Resource ID: 11314f8f-7031-4632-a0c9-c9e71a7d00eb with Priority: HIGHEST for action port [ 1667.237935] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11314f8f-7031-4632-a0c9-c9e71a7d00eb with Priority: HIGHEST for action port [ 1667.238340] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-11314f8f-7031-4632-a0c9-c9e71a7d00eb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.238460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11314f8f-7031-4632-a0c9-c9e71a7d00eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.238528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11314f8f-7031-4632-a0c9-c9e71a7d00eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.238852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11314f8f-7031-4632-a0c9-c9e71a7d00eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.238965] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11314f8f-7031-4632-a0c9-c9e71a7d00eb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1667.625506] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.625894] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.626056] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.626499] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.626598] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.626787] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 852e3e3d-b57f-4864-b82b-885c1705fad1 not found, creating... [ 1667.627115] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.627287] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.627409] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.627693] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.627872] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.629418] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.629612] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.630227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.630227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.630384] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.630547] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 852e3e3d-b57f-4864-b82b-885c1705fad1 is going to be created. [ 1667.653015] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.653015] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.653235] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.654110] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.654110] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.654110] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.745206] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11314f8f-7031-4632-a0c9-c9e71a7d00eb [ 1667.745448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.745604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.745671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1667.745882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1667.745975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1667.746109] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11314f8f-7031-4632-a0c9-c9e71a7d00eb already deleted. [ 1667.746196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11314f8f-7031-4632-a0c9-c9e71a7d00eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.742592] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.742592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.742592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.742592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.742592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.748939] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.748939] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.748939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1668.748939] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1668.886358] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-89ae9342-c488-419c-bb85-ba24b0cb7538 service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1668.886573] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-89ae9342-c488-419c-bb85-ba24b0cb7538 service nova] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1668.886759] env[71051]: INFO networking_nsxv3.common.synchronization [req-bc1f2f3b-ce17-4900-b664-b096e1d8eed9 req-89ae9342-c488-419c-bb85-ba24b0cb7538 service nova] Enqueued Resource ID: 852e3e3d-b57f-4864-b82b-885c1705fad1 with Priority: HIGHEST for action port [ 1668.887248] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_rules [ 1668.887384] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1668.887483] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 852e3e3d-b57f-4864-b82b-885c1705fad1 with Priority: HIGHEST for action port [ 1668.887760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.887849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.888522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.888645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.888860] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-852e3e3d-b57f-4864-b82b-885c1705fad1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1668.888967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1668.889051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1668.889301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1668.889388] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852e3e3d-b57f-4864-b82b-885c1705fad1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1669.250782] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d44d2b42-149f-48e5-8058-356410e335af: rpc.has_security_group_logging(os_id): False [ 1669.252031] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1669.270122] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.270452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.270600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.271160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.271160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.271281] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.271393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.272021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.272021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.272383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.273290] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.273290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.273290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.273630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.273630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.273710] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.273857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.273909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.274916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.274916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.274916] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be created. [ 1669.331099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.331278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.331278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.331555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.331853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.342645] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1669.396290] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 852e3e3d-b57f-4864-b82b-885c1705fad1 with status ACTIVE [ 1669.396626] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.396777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.396777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.397057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.397101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.397319] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.397386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.397426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.397601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.397679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.399500] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.399846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.400021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.400389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.400496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.400617] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 852e3e3d-b57f-4864-b82b-885c1705fad1 is going to be updated. [ 1669.443162] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.443316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.443390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.443615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.443754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.444032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-852e3e3d-b57f-4864-b82b-885c1705fad1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.754223] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1669.893815] env[71051]: INFO networking_nsxv3.common.synchronization [None req-160f558a-7ade-4c75-acee-52d79ef5a430 None None] Enqueued Resource ID: a6015feb-829f-4c42-81bc-a0fc6ba5f415 with Priority: HIGHEST for action port [ 1669.894099] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6015feb-829f-4c42-81bc-a0fc6ba5f415 with Priority: HIGHEST for action port [ 1669.895502] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6015feb-829f-4c42-81bc-a0fc6ba5f415 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.895759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6015feb-829f-4c42-81bc-a0fc6ba5f415" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.895759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6015feb-829f-4c42-81bc-a0fc6ba5f415" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.896017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6015feb-829f-4c42-81bc-a0fc6ba5f415" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.896192] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6015feb-829f-4c42-81bc-a0fc6ba5f415',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1670.258551] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1670.258551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1670.258551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1670.258551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1670.258551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1670.258551] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1670.284042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1670.284238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1670.284336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1670.284584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1670.284759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1670.293252] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1670.399163] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6015feb-829f-4c42-81bc-a0fc6ba5f415 [ 1670.399401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1670.399543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1670.399613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1670.399830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1670.399925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1670.400039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6015feb-829f-4c42-81bc-a0fc6ba5f415 already deleted. [ 1670.400116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6015feb-829f-4c42-81bc-a0fc6ba5f415" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1670.695752] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8a28398c-06db-451b-8220-c643cd1e75ff None None] Enqueued Resource ID: d1cf57ad-e799-4023-b314-11d99d4198dd with Priority: HIGHEST for action port [ 1670.696471] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1cf57ad-e799-4023-b314-11d99d4198dd with Priority: HIGHEST for action port [ 1670.696931] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1cf57ad-e799-4023-b314-11d99d4198dd taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1670.697169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1cf57ad-e799-4023-b314-11d99d4198dd" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1670.697279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1cf57ad-e799-4023-b314-11d99d4198dd" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1670.697611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1cf57ad-e799-4023-b314-11d99d4198dd" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1670.697759] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1cf57ad-e799-4023-b314-11d99d4198dd',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1671.202641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1cf57ad-e799-4023-b314-11d99d4198dd [ 1671.203079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.203179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.204218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.204218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.204218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.204218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1cf57ad-e799-4023-b314-11d99d4198dd already deleted. [ 1671.204218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1cf57ad-e799-4023-b314-11d99d4198dd" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.354567] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1671.354826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.355164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.355402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.355496] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1671.858354] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.858560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.092516] env[71051]: INFO networking_nsxv3.common.synchronization [req-ebddc56b-3abb-4ea8-a774-6a1f77f8a164 req-1e8c5974-0781-409f-b115-50e867b6cd9d tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1672.093348] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1672.093520] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.093650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.093749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.094077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.094212] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.094333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.094374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.094530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.094619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.094717] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.303593] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1672.303923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.304211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.304454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.305970] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.306125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.306188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.306369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.306455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.306551] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.595464] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.595464] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.596484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.596808] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.597378] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.597896] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.597896] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.598475] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.598741] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.599116] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1672.599462] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1672.599616] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1672.599886] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1672.600125] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1672.600359] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1672.600654] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1672.604011] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.604011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.604011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.604011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.604011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.604011] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.604011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.604462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.604595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.604653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.605308] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1569210-7f11-407a-992e-cc729f87d941 already deleted. [ 1672.605308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.621873] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1672.622077] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1672.622333] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1672.622393] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-700" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.623524] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-20aea63c-34b8-4570-a71e-4742f6439d7d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.623524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.623524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.623524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.623767] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aea63c-34b8-4570-a71e-4742f6439d7d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.682570] env[71051]: INFO networking_nsxv3.common.synchronization [None req-f026686c-71b9-40d4-8a33-07a72711592d None None] Enqueued Resource ID: d96ab4f5-6120-479e-8bf1-e5210776365a with Priority: HIGHEST for action port [ 1672.683280] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96ab4f5-6120-479e-8bf1-e5210776365a with Priority: HIGHEST for action port [ 1672.683650] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-d96ab4f5-6120-479e-8bf1-e5210776365a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.683952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d96ab4f5-6120-479e-8bf1-e5210776365a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.683952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d96ab4f5-6120-479e-8bf1-e5210776365a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.684234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d96ab4f5-6120-479e-8bf1-e5210776365a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.684324] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d96ab4f5-6120-479e-8bf1-e5210776365a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.809360] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.127026] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.127346] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.127492] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.127833] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.128045] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.128235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 20aea63c-34b8-4570-a71e-4742f6439d7d not found, creating... [ 1673.128554] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.128757] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.128964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.129268] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.129444] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.129790] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.129989] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.130164] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.130422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.130637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.130860] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 20aea63c-34b8-4570-a71e-4742f6439d7d is going to be created. [ 1673.152185] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.152185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.152379] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.152997] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.152997] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.153200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.187567] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d96ab4f5-6120-479e-8bf1-e5210776365a [ 1673.187889] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.188055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.188174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.188437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.188980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.188980] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d96ab4f5-6120-479e-8bf1-e5210776365a already deleted. [ 1673.188980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d96ab4f5-6120-479e-8bf1-e5210776365a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.312096] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.814772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.814971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.815143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.815519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.815688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.815903] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1673.894945] env[71051]: INFO networking_nsxv3.common.synchronization [req-ebddc56b-3abb-4ea8-a774-6a1f77f8a164 req-a4431c6b-b785-4548-b913-c75340ac27f1 service nova] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1673.895183] env[71051]: INFO networking_nsxv3.common.synchronization [req-ebddc56b-3abb-4ea8-a774-6a1f77f8a164 req-a4431c6b-b785-4548-b913-c75340ac27f1 service nova] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1673.895357] env[71051]: INFO networking_nsxv3.common.synchronization [req-ebddc56b-3abb-4ea8-a774-6a1f77f8a164 req-a4431c6b-b785-4548-b913-c75340ac27f1 service nova] Enqueued Resource ID: 20aea63c-34b8-4570-a71e-4742f6439d7d with Priority: HIGHEST for action port [ 1673.895606] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_rules [ 1673.895741] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1673.895846] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20aea63c-34b8-4570-a71e-4742f6439d7d with Priority: HIGHEST for action port [ 1673.901612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.901828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.901904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.902138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.902283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.905243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.905387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.905447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.906048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.906048] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.906781] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.906944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.907027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.907231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.907418] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.907487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.907540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.907684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.907773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.907905] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.908881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-20aea63c-34b8-4570-a71e-4742f6439d7d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.909231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.909231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.909231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.909340] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aea63c-34b8-4570-a71e-4742f6439d7d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.920659] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1674.411859] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.412183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.412308] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20aea63c-34b8-4570-a71e-4742f6439d7d with status ACTIVE [ 1674.412490] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.412618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.412686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.412988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.413102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.413296] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.413400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.413463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.413624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.413738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.413882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.413976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.414051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.414197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.414275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.414360] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20aea63c-34b8-4570-a71e-4742f6439d7d is going to be updated. [ 1674.415508] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1674.434228] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.434383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.434452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.434670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.434810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.435216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20aea63c-34b8-4570-a71e-4742f6439d7d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.919448] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1675.020097] env[71051]: INFO networking_nsxv3.common.synchronization [req-701f6ca2-8de9-4737-8f51-383dc03982ab req-28f6f09c-6edd-4023-a9f4-dfe721661b7d tempest-InstanceActionsNegativeTestJSON-391275477 tempest-InstanceActionsNegativeTestJSON-391275477-project-member] Enqueued Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1675.020097] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1675.020097] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.020097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.020097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.020792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.021068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.021288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.021445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.021688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.021867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.022045] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1675.426781] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.427165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.427165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.427333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.427441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.427548] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1569210-7f11-407a-992e-cc729f87d941 is going to be created. [ 1675.450766] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.450935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.451124] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.451267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.451458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.464893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: UNINITIALIZED for 2s [ 1675.524696] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.524978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.525123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.525388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.525486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.525720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.525831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.525971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.526125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.526207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.526310] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed already deleted. [ 1675.526394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.762200] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.762200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.762200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.762200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.762458] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.762567] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.762695] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.763330] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.763557] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.763780] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1675.763930] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1675.764248] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1675.764404] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1675.764534] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1675.767022] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1675.767022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1675.782937] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1675.783177] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1675.783538] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1675.783538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-87" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.783941] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-f3091c08-a32f-45d5-88ce-0743be025a04 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.784169] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.784300] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.784633] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.784784] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3091c08-a32f-45d5-88ce-0743be025a04',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1675.936184] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1675.936443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.936612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.936844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.937050] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.937173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.937239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.937393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.937476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.937561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.937654] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1676.287340] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.287594] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.287744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.288052] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.288208] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.288370] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port f3091c08-a32f-45d5-88ce-0743be025a04 not found, creating... [ 1676.288673] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.288846] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.288964] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.289246] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.289388] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.289680] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.289867] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.289986] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.290411] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.290616] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.291401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: f3091c08-a32f-45d5-88ce-0743be025a04 is going to be created. [ 1676.310532] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.310835] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.310993] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.311314] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.311609] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.311867] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.440243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.440514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.440514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.440696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.440885] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.440992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.441070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.441225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.441316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.441409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.441556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.441649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.441710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.441851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.441989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.442092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.442153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.442293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.442370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.442451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.442542] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1676.946397] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d44d2b42-149f-48e5-8058-356410e335af: rpc.has_security_group_logging(os_id): False [ 1676.964273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.964456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.964521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.964709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.964803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.965043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.965148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.965245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.965434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.965517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.965704] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.965799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.965861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.966061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.966111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.966267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1676.966369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1676.966422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1676.966544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1676.966625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.966710] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1677.036526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.036695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.036760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.036958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.037122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.064169] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1677.170856] env[71051]: INFO networking_nsxv3.common.synchronization [req-701f6ca2-8de9-4737-8f51-383dc03982ab req-8ba97a32-bfc4-4dfe-b285-19edfcd12d04 service nova] Enqueued Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_rules [ 1677.171026] env[71051]: INFO networking_nsxv3.common.synchronization [req-701f6ca2-8de9-4737-8f51-383dc03982ab req-8ba97a32-bfc4-4dfe-b285-19edfcd12d04 service nova] Enqueued Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1677.171175] env[71051]: INFO networking_nsxv3.common.synchronization [req-701f6ca2-8de9-4737-8f51-383dc03982ab req-8ba97a32-bfc4-4dfe-b285-19edfcd12d04 service nova] Enqueued Resource ID: f3091c08-a32f-45d5-88ce-0743be025a04 with Priority: HIGHEST for action port [ 1677.171709] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_rules [ 1677.171880] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1677.171991] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3091c08-a32f-45d5-88ce-0743be025a04 with Priority: HIGHEST for action port [ 1677.173250] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.173250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.173250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.173565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.173654] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.174951] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.176256] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.176256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.176610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.176610] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.177975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3091c08-a32f-45d5-88ce-0743be025a04 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.179372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.179372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.179372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.179372] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3091c08-a32f-45d5-88ce-0743be025a04',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.474615] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: SUCCESS [ 1677.474910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.474949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.475228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.475392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.475511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.475576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.475731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.475813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.475895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.475987] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.680605] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.680801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.681042] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.682520] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3091c08-a32f-45d5-88ce-0743be025a04 with status ACTIVE [ 1677.682626] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.682765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.682831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.683043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.683154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.683335] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.683450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.683554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.683708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.683739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.683934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.687731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.688069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.688069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.688215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.688247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3091c08-a32f-45d5-88ce-0743be025a04 is going to be updated. [ 1677.709664] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.709812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.709885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.710364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.710507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.710679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3091c08-a32f-45d5-88ce-0743be025a04" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.978978] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1678.191325] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1678.482372] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1569210-7f11-407a-992e-cc729f87d941: rpc.has_security_group_logging(os_id): False [ 1678.501989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.502212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.502289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.502525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.502639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.502997] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.503181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.503181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.503348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.503467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.503546] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1569210-7f11-407a-992e-cc729f87d941 is going to be created. [ 1678.565020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.565020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.565020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.565020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.565020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.578735] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: IN_PROGRESS for 2s [ 1678.695179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.695454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.695454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.695640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.695742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.695845] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed is going to be created. [ 1678.727911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.728119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.728166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.728348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.728554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.739991] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: UNINITIALIZED for 2s [ 1679.078037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1679.078037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.078037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.078037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.078037] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1679.580594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.581493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.581493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.581493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.581653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.581697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.581749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.581988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.582119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.582173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.582590] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.088635] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.088925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.089015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.089372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.089623] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.089785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.089892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.090121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.090275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.090416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.090655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.090815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.090920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.091133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.091333] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.091477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.092163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.092347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.092465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.092525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.092623] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.591273] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: SUCCESS [ 1680.591548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.595478] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d44d2b42-149f-48e5-8058-356410e335af: rpc.has_security_group_logging(os_id): False [ 1680.611300] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.611436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.611507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.611718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.611806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.612026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.612121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.612432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.612432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.612432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.612569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.612712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.612712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.612961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.613048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.613622] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.613622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.613622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.613622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.613622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.613622] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1680.675889] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.675889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.675889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.676082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.676506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.691471] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1680.759044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: SUCCESS [ 1680.759044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.759222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.759371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.759593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.759715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.759795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.759987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.760104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.764294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.765029] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.125734] env[71051]: INFO networking_nsxv3.common.synchronization [req-349c04a1-f9f8-426e-a504-31a1d65ba692 req-b366cbb6-0643-4658-9fe9-4439b40bd0e6 tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1681.125734] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1681.125990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.126489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.126606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.127275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.127478] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.127862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.128230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.128780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.129108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.129413] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.266864] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.267060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.267134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.267368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.267537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.267635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.267699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.267857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.267950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.268084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.268233] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.268363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.268398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.270256] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.270256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.270256] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.632493] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.771762] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a249b94-e86f-4544-bf26-60fa97eeaaed: rpc.has_security_group_logging(os_id): False [ 1681.794629] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.794629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.794778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.794961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.795127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.795419] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.795558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.795651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.795842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.795932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.796161] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.796288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.796379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.796542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.796649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.796884] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.796988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.797232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.797288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.797376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.797469] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed is going to be created. [ 1681.853450] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.853794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.853794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.853892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.854090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.865206] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: IN_PROGRESS for 2s [ 1682.135172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1682.637927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.637927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.637927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.637927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.638341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.638341] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1682.664509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.664654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.664711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.664919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.665069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.676574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1682.706896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1682.707157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1683.878867] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: SUCCESS [ 1683.879148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1684.685305] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1684.685525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.762570] env[71051]: INFO networking_nsxv3.common.synchronization [req-f7e15cba-48f3-4606-8dee-3482639debec req-5f3010aa-46a2-4418-8c4d-f48d720bf9eb tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1685.762570] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGHEST for action security_group_members [ 1685.762570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.762570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.762570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.762570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.763024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.763137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.763202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.763437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.763577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.763653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.267497] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.267925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.267925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.268063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.268103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.268308] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.268410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.268474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.268637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.268715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.268804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a is going to be updated. [ 1686.294469] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.294469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.294469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.294671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.294708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.302439] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: IN_PROGRESS for 2s [ 1686.716879] env[71051]: INFO networking_nsxv3.common.synchronization [req-2980f892-2fed-47c2-be15-af54984d4383 req-63d0a631-230c-4313-9ab0-36941a932d57 tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1686.717448] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1686.717778] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.717923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.717995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.718212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.718719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.718719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.718719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.718719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.718994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.718994] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1687.222172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1687.724448] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1688.228927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.229425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.229425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.229425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.229596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.229596] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1688.254372] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.255318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.255318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.255318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.255318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.263436] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1688.310788] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a in Status: SUCCESS [ 1688.310788] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a deletion is rescheduled due to dependency. [ 1688.310788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.732356] env[71051]: INFO networking_nsxv3.common.synchronization [req-1c24b56d-acbf-4330-85e4-98d51cc283fc req-b20ea775-a25a-49c8-9868-173048132c07 tempest-InstanceActionsNegativeTestJSON-391275477 tempest-InstanceActionsNegativeTestJSON-391275477-project-member] Enqueued Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1688.732991] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGHEST for action security_group_members [ 1688.733279] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.733399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.734445] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.734445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.734711] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1689.237017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.237349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.237349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.237471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.237569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.237764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.237863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.237923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.238099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.238177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.238263] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed is going to be updated. [ 1689.262253] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.262452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.262545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.263032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.263166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.271127] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: IN_PROGRESS for 2s [ 1690.272703] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1690.273039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.280705] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed in Status: SUCCESS [ 1691.281105] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed deletion is rescheduled due to dependency. [ 1691.281484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1693.734160] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1693.734495] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1698.734938] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1698.735251] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1698.827957] env[71051]: INFO networking_nsxv3.common.synchronization [req-cda0302c-89d9-424b-80df-18ebab610126 req-489ca703-1924-4fa9-b70e-02880b657fc0 tempest-ServersNegativeTestMultiTenantJSON-1623571178 tempest-ServersNegativeTestMultiTenantJSON-1623571178-project-member] Enqueued Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1698.828677] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1698.828899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1698.829055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1698.829143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1698.829402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1698.829567] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1698.829670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1698.829732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1698.829876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1698.829969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1698.830066] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1699.153484] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.153703] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.153839] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.154229] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.154524] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.154672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.154808] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.155053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.155309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.155567] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1699.155692] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1699.155809] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1699.155926] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1699.156057] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1699.156174] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1699.156314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1699.177633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1699.177633] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1699.178646] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1699.178646] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.179901] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-8eabdff5-7705-4b4d-822b-6107ffa0b356 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.179901] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.179901] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.179901] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.179901] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eabdff5-7705-4b4d-822b-6107ffa0b356',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1699.333637] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.333802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.333905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.334154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.334247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.334448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.334547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.334600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.334751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.334826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.334909] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9ad0e2-035b-4633-b1f0-56f049ff846d already deleted. [ 1699.334990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.682635] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.682957] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.683317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.683486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.683650] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.683858] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 8eabdff5-7705-4b4d-822b-6107ffa0b356 not found, creating... [ 1699.684171] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.684345] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.684600] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.684710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.684867] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.685179] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.685349] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.685471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.685689] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.685826] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.685973] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 8eabdff5-7705-4b4d-822b-6107ffa0b356 is going to be created. [ 1699.705781] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.705781] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.706070] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.706413] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.706731] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.706979] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.394262] env[71051]: INFO networking_nsxv3.common.synchronization [req-cda0302c-89d9-424b-80df-18ebab610126 req-463dd99c-9eaa-4977-81fc-13f149f83314 service nova] Enqueued Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_rules [ 1700.394498] env[71051]: INFO networking_nsxv3.common.synchronization [req-cda0302c-89d9-424b-80df-18ebab610126 req-463dd99c-9eaa-4977-81fc-13f149f83314 service nova] Enqueued Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1700.394593] env[71051]: INFO networking_nsxv3.common.synchronization [req-cda0302c-89d9-424b-80df-18ebab610126 req-463dd99c-9eaa-4977-81fc-13f149f83314 service nova] Enqueued Resource ID: 8eabdff5-7705-4b4d-822b-6107ffa0b356 with Priority: HIGHEST for action port [ 1700.394822] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_rules [ 1700.394955] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1700.395065] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eabdff5-7705-4b4d-822b-6107ffa0b356 with Priority: HIGHEST for action port [ 1700.396049] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.396185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.396257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.396509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.396593] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.397427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.397555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.397630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.397828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.397974] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.398088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.398144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.398283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.398402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.398437] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.399138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eabdff5-7705-4b4d-822b-6107ffa0b356 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.399247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.399313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.399463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.399537] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eabdff5-7705-4b4d-822b-6107ffa0b356',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.901891] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.902775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.902775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.902775] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eabdff5-7705-4b4d-822b-6107ffa0b356 with status ACTIVE [ 1700.903541] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.903541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.903541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.903541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.903843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.903843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.903984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.903984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.904095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.904177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.904638] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.904638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.904638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.904830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.904830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.904830] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eabdff5-7705-4b4d-822b-6107ffa0b356 is going to be updated. [ 1700.925247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.925247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.925247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.925247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.925247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.925506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eabdff5-7705-4b4d-822b-6107ffa0b356" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1701.406582] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1701.908892] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1701.909079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1701.909152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1701.909370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1701.909468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1701.909569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9ad0e2-035b-4633-b1f0-56f049ff846d is going to be created. [ 1701.932338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1701.932478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1701.932537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1701.932765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1701.932966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1701.941478] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: UNINITIALIZED for 2s [ 1702.369895] env[71051]: INFO networking_nsxv3.common.synchronization [req-625c7eee-03c4-4b18-97f2-9d22a16f62cd req-1e7508ef-81c2-4ad0-b5a4-b58488d2e022 tempest-ListImageFiltersTestJSON-1814967747 tempest-ListImageFiltersTestJSON-1814967747-project-member] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1702.370358] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1702.370642] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.370781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1702.370859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1702.371353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1702.371531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.373018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1702.373018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1702.373018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1702.373018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1702.373018] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1702.874057] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1703.376636] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1703.878919] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.879216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1703.879216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1703.879393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1703.879486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1703.879585] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be updated. [ 1703.911843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.911843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1703.911843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1703.911843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1703.911843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1703.917740] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1703.951320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: SUCCESS [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1703.951320] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1703.951320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1703.951320] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.453526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.453750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.453750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.454122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.454363] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.454465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.454533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.458773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.458773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.458773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.458773] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.794442] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0badf46-f4bb-46c3-9cd8-73c548d20e77 req-bd75a60f-4900-4cbb-8f25-aca5bb2973d0 tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1704.794442] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1704.794805] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.795443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.795443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.795443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.795674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.795674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.795971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.796096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.797661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.797661] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.963757] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9ad0e2-035b-4633-b1f0-56f049ff846d: rpc.has_security_group_logging(os_id): False [ 1704.981610] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.981759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.981835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.982115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.982211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.983042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.983176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.983247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.983406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.983488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.983679] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.983777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.983832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.983996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.984478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.984666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.985174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1704.985240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1704.985375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1704.985452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.985542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9ad0e2-035b-4633-b1f0-56f049ff846d is going to be created. [ 1705.043457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.043609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.043673] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.043915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.044114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.056571] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: IN_PROGRESS for 2s [ 1705.186021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.186021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.186021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.186355] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1705.186355] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1705.186355] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1705.186457] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1705.186556] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1705.186666] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1705.186805] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1705.213844] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1705.214017] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1705.214193] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1705.214426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.215103] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-29465047-4434-4c54-8fd3-55f66bfa7994 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.215103] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.215103] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.215478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.215642] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29465047-4434-4c54-8fd3-55f66bfa7994',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1705.300423] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.302117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.302117] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 already deleted. [ 1705.302117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.721530] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.721779] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.722220] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.722220] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.722367] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.722524] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 29465047-4434-4c54-8fd3-55f66bfa7994 not found, creating... [ 1705.722794] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.723050] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.723128] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.723366] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.723565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.723827] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.723993] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.724160] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.724382] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.724525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.724673] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 29465047-4434-4c54-8fd3-55f66bfa7994 is going to be created. [ 1705.744095] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1705.745119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1705.745119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1705.745119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1705.745119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.745339] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1705.929232] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1705.929232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1706.500623] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0badf46-f4bb-46c3-9cd8-73c548d20e77 req-9bb9746b-017e-4d1e-955c-ed14c1b272a8 service nova] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1706.500884] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0badf46-f4bb-46c3-9cd8-73c548d20e77 req-9bb9746b-017e-4d1e-955c-ed14c1b272a8 service nova] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1706.500952] env[71051]: INFO networking_nsxv3.common.synchronization [req-a0badf46-f4bb-46c3-9cd8-73c548d20e77 req-9bb9746b-017e-4d1e-955c-ed14c1b272a8 service nova] Enqueued Resource ID: 29465047-4434-4c54-8fd3-55f66bfa7994 with Priority: HIGHEST for action port [ 1706.501563] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1706.501709] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1706.502172] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29465047-4434-4c54-8fd3-55f66bfa7994 with Priority: HIGHEST for action port [ 1706.502172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1706.502305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1706.502305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1706.502485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1706.502568] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1706.503471] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1706.503558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1706.503775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1706.503837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1706.503958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1706.504652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1706.504731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1706.504880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1706.504967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1706.505074] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1706.505986] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-29465047-4434-4c54-8fd3-55f66bfa7994 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1706.505986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1706.505986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1706.506191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1706.506244] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29465047-4434-4c54-8fd3-55f66bfa7994',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1707.010843] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1707.011239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.011352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.011561] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29465047-4434-4c54-8fd3-55f66bfa7994 with status ACTIVE [ 1707.011761] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.011874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.011937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.012157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.012577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.012577] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.012577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.012577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.012760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.012793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.013155] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.013155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.013318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.013349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.013428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.013508] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29465047-4434-4c54-8fd3-55f66bfa7994 is going to be updated. [ 1707.035696] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.035696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.035807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.036012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.036175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.036411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.070914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: SUCCESS [ 1707.070914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.255536] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae5f14cf-333c-4d30-9bac-1002b8f2f26e req-baaa06ec-95ce-4261-9ee5-800f04744b40 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1707.256220] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1707.256409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.256541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.256639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.256986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.257612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.257792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.258039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.258310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.259231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.259401] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1707.517800] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1707.573179] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.573179] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.573179] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.573541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.573643] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.577019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.577019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.577019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.577019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.577019] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1707.577019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1707.577019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1707.577019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1707.577019] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1707.577019] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1707.577019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1707.601544] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1707.601544] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1707.601544] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1707.602181] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1707.602181] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-f652103d-661c-4cb6-99e6-f3a233406865 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.602181] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1707.602520] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1707.602597] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1707.602855] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f652103d-661c-4cb6-99e6-f3a233406865',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1707.763243] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1708.023905] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.024105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.024140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.024350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.024946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.024946] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 is going to be created. [ 1708.044646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.044791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.044865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.045100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.045342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.054531] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: UNINITIALIZED for 2s [ 1708.107601] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.107917] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.108098] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.108507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.108701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.108893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port f652103d-661c-4cb6-99e6-f3a233406865 not found, creating... [ 1708.109218] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.109418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.109585] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.109881] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.111195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.111195] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.111195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.111195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.111477] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.111645] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.111828] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: f652103d-661c-4cb6-99e6-f3a233406865 is going to be created. [ 1708.131051] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.131415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.131594] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.131911] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.132168] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.132402] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.266799] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1708.769711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.770065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.770065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.770319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.770499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.770622] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1708.797249] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.797401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.797471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.797774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.797774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1708.812024] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1708.876393] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae5f14cf-333c-4d30-9bac-1002b8f2f26e req-d69e89b0-a38d-4d5e-95a5-f8b1ab86b076 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1708.876393] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae5f14cf-333c-4d30-9bac-1002b8f2f26e req-d69e89b0-a38d-4d5e-95a5-f8b1ab86b076 service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1708.876393] env[71051]: INFO networking_nsxv3.common.synchronization [req-ae5f14cf-333c-4d30-9bac-1002b8f2f26e req-d69e89b0-a38d-4d5e-95a5-f8b1ab86b076 service nova] Enqueued Resource ID: f652103d-661c-4cb6-99e6-f3a233406865 with Priority: HIGHEST for action port [ 1708.879436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1708.879436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1708.879436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f652103d-661c-4cb6-99e6-f3a233406865 with Priority: HIGHEST for action port [ 1708.879436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.879436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.879436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.879436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.879436] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1708.880142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.880142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.880628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f652103d-661c-4cb6-99e6-f3a233406865 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1708.880628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1708.880736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1708.880866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1708.880968] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f652103d-661c-4cb6-99e6-f3a233406865',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.265664] env[71051]: INFO networking_nsxv3.common.synchronization [req-12a3e5cc-de62-443b-9076-01bc6e60f515 req-f0e0f135-0b0a-47d2-9841-55ce84d1beb9 tempest-VolumesAdminNegativeTest-338487935 tempest-VolumesAdminNegativeTest-338487935-project-member] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1709.266594] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGHEST for action security_group_members [ 1709.268905] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.269105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.269210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.269620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.269620] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.269779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.269869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.270065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.270192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.270319] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.382318] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.382898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.383221] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f652103d-661c-4cb6-99e6-f3a233406865 with status ACTIVE [ 1709.384164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.384164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.384164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.384164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.384164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.384164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.384527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.384527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.384527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.384641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.384837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.384837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.384986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.385049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.385119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.385207] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f652103d-661c-4cb6-99e6-f3a233406865 is going to be updated. [ 1709.405303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.405303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.405303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.405529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.405529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.405676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f652103d-661c-4cb6-99e6-f3a233406865" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.772591] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.772977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.772977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.773142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.773240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.773457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.773553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.773620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.773776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.773878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.773989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 is going to be updated. [ 1709.805827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.806339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.806339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.806505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.807436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.818678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: IN_PROGRESS for 2s [ 1710.060405] env[71051]: INFO networking_nsxv3.common.synchronization [req-04f17283-4486-47a6-abc2-47f6bf2cba2e req-68bae00c-a5c0-44b5-a71a-1075a0777320 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1710.061117] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1710.064210] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.064210] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.064210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.064210] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1710.068785] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: SUCCESS [ 1710.069517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.070365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.070843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.071094] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.071255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.071351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.071553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.071898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.072039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.072269] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1710.569424] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.570123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.570123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.570123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.570123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.573106] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.573106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.573106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.573106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.573106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.573106] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1710.576433] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1710.595035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.595035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.595035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.595035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.595035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.602978] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1710.821844] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1710.823693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.824662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.825597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.825891] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.826255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.826430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.826827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.827027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.827211] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.076109] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.076109] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.076109] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.076585] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.076908] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1711.077146] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1711.077356] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1711.077938] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1711.078179] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1711.078391] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1711.078616] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1711.081070] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd2b78d5-f56c-47e2-a26e-d87bff454fb0: rpc.has_security_group_logging(os_id): False [ 1711.112027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.112027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.112027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.112027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 is going to be created. [ 1711.127156] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1711.127156] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1711.127156] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1711.127156] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.127156] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-9208deaa-da9e-4703-bca5-906dee0dd228 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.127156] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.127156] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.127156] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.127156] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9208deaa-da9e-4703-bca5-906dee0dd228',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.175467] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.175467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.175467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.175467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.175467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.183353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: IN_PROGRESS for 2s [ 1711.212254] env[71051]: INFO networking_nsxv3.common.synchronization [req-2b7b3464-f207-48ed-8913-61008c7eb3b6 req-3ff4a44f-f1f7-4a75-b20d-7ae35a8d77c0 tempest-ServersNegativeTestMultiTenantJSON-1623571178 tempest-ServersNegativeTestMultiTenantJSON-1623571178-project-member] Enqueued Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1711.213731] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9ad0e2-035b-4633-b1f0-56f049ff846d with Priority: HIGHEST for action security_group_members [ 1711.214115] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9ad0e2-035b-4633-b1f0-56f049ff846d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.214284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.214360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.214635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.214722] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.214832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.214892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.215061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.215155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.215247] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9ad0e2-035b-4633-b1f0-56f049ff846d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.329561] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.631137] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.631432] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.631555] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.631933] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.632198] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.632432] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 9208deaa-da9e-4703-bca5-906dee0dd228 not found, creating... [ 1711.632867] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.633079] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.633293] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.633620] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.633991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.634242] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.634477] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.634637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.634932] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.635165] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.635382] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 9208deaa-da9e-4703-bca5-906dee0dd228 is going to be created. [ 1711.680305] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.680631] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.680780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.681134] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.681464] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.681856] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.718615] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.718769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.718863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.719167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.719269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.719466] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.719574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.719636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.719796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.719895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.720037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9ad0e2-035b-4633-b1f0-56f049ff846d is going to be updated. [ 1711.748303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.748492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.748578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.748892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.748994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.756977] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: IN_PROGRESS for 2s [ 1711.832747] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.836926] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 in Status: SUCCESS [ 1711.840505] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 deletion is rescheduled due to dependency. [ 1711.840637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.907411] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fc17b34d-59ad-4486-9b82-3255d98a0389 None None] Enqueued Resource ID: ee158c90-03b0-4b5e-8ef9-29df7c8768b6 with Priority: HIGHEST for action port [ 1711.907411] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee158c90-03b0-4b5e-8ef9-29df7c8768b6 with Priority: HIGHEST for action port [ 1711.907411] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee158c90-03b0-4b5e-8ef9-29df7c8768b6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.907411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee158c90-03b0-4b5e-8ef9-29df7c8768b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.907411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee158c90-03b0-4b5e-8ef9-29df7c8768b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.907411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee158c90-03b0-4b5e-8ef9-29df7c8768b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.907411] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee158c90-03b0-4b5e-8ef9-29df7c8768b6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.336122] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.336295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.338040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.338040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.338040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.338040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1712.362973] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.362973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.362973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.363116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.364312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.372804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1712.409669] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee158c90-03b0-4b5e-8ef9-29df7c8768b6 [ 1712.409984] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.410956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.410956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.410956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.410956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.411155] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee158c90-03b0-4b5e-8ef9-29df7c8768b6 already deleted. [ 1712.411216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee158c90-03b0-4b5e-8ef9-29df7c8768b6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.614195] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1712.614195] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1712.614285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.627529] env[71051]: INFO networking_nsxv3.common.synchronization [req-736b9976-609d-4d80-9420-1ac2af32dabe req-3b00002d-244a-4706-a0af-f968d2e59420 tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1712.628211] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1712.628597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.628728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.628799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.629236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.629448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.629576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.629624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.629795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.629885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.629984] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.635409] env[71051]: INFO networking_nsxv3.common.synchronization [req-04f17283-4486-47a6-abc2-47f6bf2cba2e req-3b7402cf-2442-4334-9b1f-816d360d3bbf service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1712.638243] env[71051]: INFO networking_nsxv3.common.synchronization [req-04f17283-4486-47a6-abc2-47f6bf2cba2e req-3b7402cf-2442-4334-9b1f-816d360d3bbf service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1712.638243] env[71051]: INFO networking_nsxv3.common.synchronization [req-04f17283-4486-47a6-abc2-47f6bf2cba2e req-3b7402cf-2442-4334-9b1f-816d360d3bbf service nova] Enqueued Resource ID: 9208deaa-da9e-4703-bca5-906dee0dd228 with Priority: HIGHEST for action port [ 1712.638243] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1712.638243] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1712.638243] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9208deaa-da9e-4703-bca5-906dee0dd228 with Priority: HIGHEST for action port [ 1712.638243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.638243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.638243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.638243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.638243] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.639445] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.639553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.639619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.639971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.642323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.642323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.642323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.642323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.642323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.642323] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.642323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9208deaa-da9e-4703-bca5-906dee0dd228 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.643934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.643934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.643934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.643934] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9208deaa-da9e-4703-bca5-906dee0dd228',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.895988] env[71051]: INFO networking_nsxv3.common.synchronization [req-5ac2942e-8bec-48e4-9072-31d64d02b5d7 req-bb8fcd31-a8d9-4484-9f14-fcbb6bcc0a9e tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1712.896543] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1712.896857] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.896977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.897442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.897670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.897834] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.897932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.897988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.898174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.898253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.898347] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.024496] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-814 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.024496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.024496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.024496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.024496] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.024496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.024496] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.024962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.024962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.026215] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1713.026215] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1713.026215] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1713.026215] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1713.026215] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1713.026215] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1713.026215] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1713.042752] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1713.042964] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1713.043158] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1713.043319] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-814" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.043950] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-841e0da0-e7c8-4dae-a46c-b92c5c83945c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.043950] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.043950] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.044306] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.044452] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('841e0da0-e7c8-4dae-a46c-b92c5c83945c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.134020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.134020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.134020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.134020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.134020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.134285] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.134285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.134285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.134397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.136525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.136525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1713.140029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.140029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.143543] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.144237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9208deaa-da9e-4703-bca5-906dee0dd228 with status ACTIVE [ 1713.144430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.144561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.144652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.144887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.144987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.145174] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.145272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.145336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.145492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.145571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.145745] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.145839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.145901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.146062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.146141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.146228] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9208deaa-da9e-4703-bca5-906dee0dd228 is going to be updated. [ 1713.164024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.164024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.164024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.164024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.164024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.167485] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.167616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.167669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.167844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.167965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.168126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9208deaa-da9e-4703-bca5-906dee0dd228" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.175974] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1713.195529] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: SUCCESS [ 1713.195751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.401821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.550453] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.550718] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.550860] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.551226] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.551399] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.551570] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 841e0da0-e7c8-4dae-a46c-b92c5c83945c not found, creating... [ 1713.551881] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.552031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.552227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.552404] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.552565] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.552807] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.552992] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.554224] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.555317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.555869] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.556585] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 841e0da0-e7c8-4dae-a46c-b92c5c83945c is going to be created. [ 1713.579552] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.580121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.580121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.583021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.583021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.583021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.648655] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.774897] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9ad0e2-035b-4633-b1f0-56f049ff846d in Status: SUCCESS [ 1713.775110] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9ad0e2-035b-4633-b1f0-56f049ff846d deletion is rescheduled due to dependency. [ 1713.775231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9ad0e2-035b-4633-b1f0-56f049ff846d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.903142] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1714.152026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.152026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.152026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.152026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.152248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.152248] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1714.180826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.180826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.180826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.180826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.180826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.188252] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1714.300730] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4cf60a38-a556-468f-a511-8eb8925ad44b None None] Enqueued Resource ID: cf00b0bd-2432-46e3-828b-4890d6397dc7 with Priority: HIGHEST for action port [ 1714.305999] env[71051]: INFO networking_nsxv3.common.synchronization [req-736b9976-609d-4d80-9420-1ac2af32dabe req-bc447bab-7026-4b58-9883-322535f3fbc9 service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1714.309056] env[71051]: INFO networking_nsxv3.common.synchronization [req-736b9976-609d-4d80-9420-1ac2af32dabe req-bc447bab-7026-4b58-9883-322535f3fbc9 service nova] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1714.309056] env[71051]: INFO networking_nsxv3.common.synchronization [req-736b9976-609d-4d80-9420-1ac2af32dabe req-bc447bab-7026-4b58-9883-322535f3fbc9 service nova] Enqueued Resource ID: 841e0da0-e7c8-4dae-a46c-b92c5c83945c with Priority: HIGHEST for action port [ 1714.309056] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf00b0bd-2432-46e3-828b-4890d6397dc7 with Priority: HIGHEST for action port [ 1714.309056] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1714.309706] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_rules [ 1714.314015] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e0da0-e7c8-4dae-a46c-b92c5c83945c with Priority: HIGHEST for action port [ 1714.314015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf00b0bd-2432-46e3-828b-4890d6397dc7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.314015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf00b0bd-2432-46e3-828b-4890d6397dc7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.314015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf00b0bd-2432-46e3-828b-4890d6397dc7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.314410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf00b0bd-2432-46e3-828b-4890d6397dc7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.314577] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf00b0bd-2432-46e3-828b-4890d6397dc7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1714.315637] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.315731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.316352] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.316352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.316352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.316493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.322023] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1714.322023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-841e0da0-e7c8-4dae-a46c-b92c5c83945c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.322023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.322023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.322023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.322023] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('841e0da0-e7c8-4dae-a46c-b92c5c83945c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1714.382044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1714.382338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.382891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.383157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.383358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.383521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.383630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.383859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.384012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.384189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.384336] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1714.406151] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.406475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.406587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.406835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.406917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.407035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be updated. [ 1714.435361] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.435538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.435603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.435818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.435972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.447020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1714.820816] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.821063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.821275] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf00b0bd-2432-46e3-828b-4890d6397dc7 [ 1714.821493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.821614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.821684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.821900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.821996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.822104] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf00b0bd-2432-46e3-828b-4890d6397dc7 already deleted. [ 1714.822273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf00b0bd-2432-46e3-828b-4890d6397dc7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.823511] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 841e0da0-e7c8-4dae-a46c-b92c5c83945c with status ACTIVE [ 1714.823758] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.823920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.824191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.824407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.824592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.824693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.824954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.824954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.825082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.825202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.825480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.825667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.825732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.825881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.825959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.826095] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 841e0da0-e7c8-4dae-a46c-b92c5c83945c is going to be updated. [ 1714.845750] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.845864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.845864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.846106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.846248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.847209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-841e0da0-e7c8-4dae-a46c-b92c5c83945c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.888067] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.888311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.888311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.888463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.888661] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.888799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.888879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.888989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.889081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.889186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.889335] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.889433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.889499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.889649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.889788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1714.889882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1714.889949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1714.890120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1714.890198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.890268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1714.890379] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.188396] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1715.188396] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b deletion is rescheduled due to dependency. [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.188396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.188396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.188396] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.327299] env[71051]: INFO networking_nsxv3.common.synchronization [req-1350fa9d-ab12-4088-94e5-b05cf1744fc7 req-e5e1a068-2052-4714-8275-04857e50a3ad tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 1715.327887] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 1715.328233] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.328361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.328434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.328668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.328833] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.328937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.329011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.329208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.329290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.329386] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.392702] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49e506d-62f2-4518-a039-ac618500914a: rpc.has_security_group_logging(os_id): False [ 1715.413254] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.413413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.413487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.413692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.413788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.413997] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.414151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.414191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.414346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.414426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.414625] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.414722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.414783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.414918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.414992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.415191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.415280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.415340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.415477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.415550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.415636] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1715.475548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.475849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.475849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.475929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.476096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.496262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1715.655121] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.655419] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.655574] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.655857] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.656176] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.656506] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.656506] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.656710] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.656864] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.660193] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1715.660193] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1715.660193] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1715.660193] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1715.660193] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1715.660193] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1715.660193] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1715.680968] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1715.681218] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1715.681366] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1715.681552] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.681882] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.682090] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.682218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.682572] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.682967] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdc7b9-fd6e-4fd2-84b4-ede96963d251',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.691396] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.832614] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.832801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.832888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.833167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.833351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.833451] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.833583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.833641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.833782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.833829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.833911] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a already deleted. [ 1715.834014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.098649] env[71051]: INFO networking_nsxv3.common.synchronization [req-98d4fd09-b5d6-4b34-8ed2-2dd07c295bb3 req-14f861a2-8589-42e1-984e-4f0691a4f553 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1716.099491] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1716.099823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.099948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.100028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.104152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.104152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.104152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.104152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.104152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.104152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.104152] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1716.189021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.189021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 not found, creating... [ 1716.189021] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.189021] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.189739] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.189739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.189739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.189739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.189739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.190209] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 is going to be created. [ 1716.193337] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1716.203309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.203309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.203309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.203309] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1716.212165] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.212165] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.212321] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.212635] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.212901] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.213318] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.455136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1716.455514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.604542] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.604542] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.604542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.604952] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1716.632765] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.633099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.633225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.633397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.633576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.644395] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1716.695737] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.695858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.695944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.696165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.696268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.696503] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1716.706257] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.706483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.706483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.706703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.706891] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.706999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.707085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.707232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.707344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.707449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.707599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.707693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.707753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.707896] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.708050] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.708399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.708399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.708399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.708399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.708559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.708559] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1716.727131] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.727317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.727357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.727563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.727712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.738602] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1717.211935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1717.231119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.231119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.231119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.231273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.231874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.231874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.231874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.231874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.232184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.232184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.232184] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.232294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.232328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.232455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.232536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.232760] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.232859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.232921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.233119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.233203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.233292] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1717.294276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.294276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.294276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.294276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.294276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.305727] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1717.360388] env[71051]: INFO networking_nsxv3.common.synchronization [req-1350fa9d-ab12-4088-94e5-b05cf1744fc7 req-aa21f3b1-1291-431e-8d51-7386e15448b1 service nova] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1717.360557] env[71051]: INFO networking_nsxv3.common.synchronization [req-1350fa9d-ab12-4088-94e5-b05cf1744fc7 req-aa21f3b1-1291-431e-8d51-7386e15448b1 service nova] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 1717.360763] env[71051]: INFO networking_nsxv3.common.synchronization [req-1350fa9d-ab12-4088-94e5-b05cf1744fc7 req-aa21f3b1-1291-431e-8d51-7386e15448b1 service nova] Enqueued Resource ID: 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 with Priority: HIGHEST for action port [ 1717.361462] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_rules [ 1717.361600] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 1717.361684] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 with Priority: HIGHEST for action port [ 1717.362016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.362620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.362698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.362914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.363112] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1717.366427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.366427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.366427] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1717.366427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.366427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.366427] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdc7b9-fd6e-4fd2-84b4-ede96963d251',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1717.513802] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1717.513802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.869822] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1717.872911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.872911] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 with status ACTIVE [ 1717.872911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.872911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.872911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.872911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.873765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.873765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.873765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.873765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.873765] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20bdc7b9-fd6e-4fd2-84b4-ede96963d251 is going to be updated. [ 1717.899977] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.900160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.900230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.900481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.900628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.900819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bdc7b9-fd6e-4fd2-84b4-ede96963d251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.133811] env[71051]: INFO networking_nsxv3.common.synchronization [req-c34b56e0-57d3-49be-9c66-0042cde8ce89 req-24acc154-26da-4828-a7ee-2afcaa02c1d8 tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1718.134499] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1718.134844] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.134977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.135052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.135350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.135477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.135573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.135739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.135782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.135871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.135966] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.376410] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.501544] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.501544] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.501544] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.501745] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.502087] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.502273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.502396] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.502632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.502781] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.503409] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1718.503409] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1718.503409] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1718.503618] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1718.503618] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1718.503730] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1718.503934] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1718.522309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1718.522485] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1718.522623] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1718.522851] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.523241] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.523419] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.523543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.523858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.524023] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.638441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.638570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.638619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.643023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.643023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 already deleted. [ 1718.643023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.655618] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1718.656040] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1718.656093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.747258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1718.747475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.747645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.747884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.748141] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.748297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.748371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.748566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.748654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.748742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.748839] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.880565] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.880727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.880786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.881017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.881127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.881220] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a is going to be created. [ 1718.915847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.916027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.916120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.916326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.916449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.927205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: UNINITIALIZED for 2s [ 1719.026520] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.026769] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.026904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.027236] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.027401] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.027562] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 not found, creating... [ 1719.027831] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.027994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.028131] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.028354] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.028498] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.028783] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.028946] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.029127] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.029363] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.029504] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.029652] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 is going to be created. [ 1719.049854] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.049854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.049854] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.050382] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.050678] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.051040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.253934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.253934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.253934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.253934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.253934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.254614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.254614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.254614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.254614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.254614] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1719.319543] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1719.319793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.761035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b: rpc.has_security_group_logging(os_id): False [ 1719.777648] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.777954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.777954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.778181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.778281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.778525] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.778629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.778694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.778851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.778931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.779207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.779274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.779306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.779521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.779521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.779677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.779805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.779895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.779975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.780758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.780758] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1719.835063] env[71051]: INFO networking_nsxv3.common.synchronization [req-96d35474-59a7-45e9-85df-81d7f9b9ea50 req-90d001fc-8656-4348-a26e-a91474a1fed9 tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1719.835665] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1719.835966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.836559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.836656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.836845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.838655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.838813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.839011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.839131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.839249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.839373] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1719.856052] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.856288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1719.856362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1719.856540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1719.857140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1719.876381] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1719.926325] env[71051]: INFO networking_nsxv3.common.synchronization [req-084c02f6-0bdc-48e1-800e-f186d06bfe66 req-fe769452-7805-40da-91e9-c3646b962efa tempest-ListServersNegativeTestJSON-2034826448 tempest-ListServersNegativeTestJSON-2034826448-project-member] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1719.926325] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGHEST for action security_group_members [ 1719.927237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1719.928213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.153646] env[71051]: INFO networking_nsxv3.common.synchronization [req-c34b56e0-57d3-49be-9c66-0042cde8ce89 req-7fefcd27-a5c9-410b-9a22-9e426c733a60 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1720.153893] env[71051]: INFO networking_nsxv3.common.synchronization [req-c34b56e0-57d3-49be-9c66-0042cde8ce89 req-7fefcd27-a5c9-410b-9a22-9e426c733a60 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1720.154048] env[71051]: INFO networking_nsxv3.common.synchronization [req-c34b56e0-57d3-49be-9c66-0042cde8ce89 req-7fefcd27-a5c9-410b-9a22-9e426c733a60 service nova] Enqueued Resource ID: a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 with Priority: HIGHEST for action port [ 1720.154654] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1720.154930] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1720.154930] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 with Priority: HIGHEST for action port [ 1720.155848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.155980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.156064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.156344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.156474] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.157523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.157797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.157797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.158103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.158407] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.158407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.158536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.158625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.158768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.158926] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.161853] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.161853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.161853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.161853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.161853] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.342698] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.435124] env[71051]: INFO networking_nsxv3.common.synchronization [None req-85428770-6609-4441-9535-274fc6b9c5e2 tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1720.435754] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1720.436100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.436239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.436309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.436571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.436661] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.545216] env[71051]: INFO networking_nsxv3.common.synchronization [None req-30eb3835-e9a9-4207-ba4c-8c735fa98ed0 tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1720.546890] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1720.548295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.548295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.662948] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.664156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.664282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.665400] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 with status ACTIVE [ 1720.665400] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.665400] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.665400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.666188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.666188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.666188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.666188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.666188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.667242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.667242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.667242] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1 is going to be updated. [ 1720.691571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.691717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.692255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.692255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.692255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.692440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a51328d9-f8e4-48af-a8b3-42e8ae7f2ea1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.844653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.937076] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: SUCCESS [ 1720.937311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.937481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.937712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.937937] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.938035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.938106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.938272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.938358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.938447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.939243] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.957957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.958130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.958206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.958420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.958516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.958614] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 already deleted. [ 1720.959760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.959760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.959760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.959760] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1720.987071] env[71051]: INFO networking_nsxv3.common.synchronization [req-ffa37d4f-807f-4543-b5b0-43efe2d18dce req-416b135e-d33b-42ed-93d3-beb83551d1df tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1720.987703] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1720.991721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.991928] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.169405] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.349553] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.349718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.349787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.350032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.350205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.350330] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1721.383745] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.383906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.384077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.384316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.384841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.393366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1721.446654] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.479944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.480129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.480646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.481302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.481416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.482675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 already deleted. [ 1721.482675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.556275] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.556493] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.556628] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.556953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.557700] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.557700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.557700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.557995] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.557995] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.558270] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1721.558473] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1721.558601] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1721.558745] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1721.558979] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1721.559237] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1721.559373] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1721.579316] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1721.579632] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1721.580301] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1721.580301] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.580603] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-221150ab-1980-4107-817a-b5b4a7c53786 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.580801] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.581020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.581484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.582080] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221150ab-1980-4107-817a-b5b4a7c53786',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.674135] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.674324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.674462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.674605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.674695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.674831] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be created. [ 1721.708477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.708655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.708697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.708895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.709091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.719901] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: UNINITIALIZED for 2s [ 1721.889640] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1721.889640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.951555] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fbed01f-5a92-4b01-a2c0-374a5bd0301a: rpc.has_security_group_logging(os_id): False [ 1721.967974] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.968269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.968348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.968642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.968642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.968890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.969047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.969094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.969712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.969712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.969712] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a is going to be created. [ 1722.023781] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.023938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.024031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.024275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.024479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.035577] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: IN_PROGRESS for 2s [ 1722.085534] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.085828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.085923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.086486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.086486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.086583] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 221150ab-1980-4107-817a-b5b4a7c53786 not found, creating... [ 1722.086841] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.090075] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.090075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.090075] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 221150ab-1980-4107-817a-b5b4a7c53786 is going to be created. [ 1722.111099] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.111099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.111099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.111372] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.111475] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.112528] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.882894] env[71051]: INFO networking_nsxv3.common.synchronization [req-ffa37d4f-807f-4543-b5b0-43efe2d18dce req-557644be-bc64-409c-a436-12d7a4f26633 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1722.883173] env[71051]: INFO networking_nsxv3.common.synchronization [req-ffa37d4f-807f-4543-b5b0-43efe2d18dce req-557644be-bc64-409c-a436-12d7a4f26633 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1722.883367] env[71051]: INFO networking_nsxv3.common.synchronization [req-ffa37d4f-807f-4543-b5b0-43efe2d18dce req-557644be-bc64-409c-a436-12d7a4f26633 service nova] Enqueued Resource ID: 221150ab-1980-4107-817a-b5b4a7c53786 with Priority: HIGHEST for action port [ 1722.883873] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1722.884106] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1722.884342] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 221150ab-1980-4107-817a-b5b4a7c53786 with Priority: HIGHEST for action port [ 1722.884629] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.884740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.886304] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.886414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.886624] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-221150ab-1980-4107-817a-b5b4a7c53786 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.886731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.886797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.886994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.887100] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221150ab-1980-4107-817a-b5b4a7c53786',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.389937] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 221150ab-1980-4107-817a-b5b4a7c53786 with status ACTIVE [ 1723.390168] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.390168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.390298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.390449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.390544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.390722] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.390820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.391209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.391209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.391446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.391493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.391580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.391632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.391854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.391944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.392049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 221150ab-1980-4107-817a-b5b4a7c53786 is going to be updated. [ 1723.405575] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1723.405796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.405957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.406373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.406373] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.406496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.406496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.407414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.407414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.407414] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.414655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.414655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.414655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.414843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.415016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.415180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-221150ab-1980-4107-817a-b5b4a7c53786" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.733790] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1723.734303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.735027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.735142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.735325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.735471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.735635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.736033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.736192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.736293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.736557] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.737718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.738068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.738293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.738487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.738536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.738723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.739039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.739193] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.912362] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.912526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.912603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.912827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.913044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.913180] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.913286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.913353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.913510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.913590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.913679] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be updated. [ 1723.944202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.944299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.944390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.944744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.944944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.955469] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: IN_PROGRESS for 2s [ 1724.047591] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: SUCCESS [ 1724.047887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.241347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.241347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.245751] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1724.747785] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1725.251171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.251385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.251435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.251868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.251970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.252096] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1725.279880] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.280103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.280631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.280631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.280730] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.289558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1725.840240] env[71051]: INFO networking_nsxv3.common.synchronization [req-979924e6-8535-4484-bd66-58c9470e5e4b req-b674c6d4-7f17-4a93-ad69-6e8cedb4751e tempest-ListServerFiltersTestJSON-515523146 tempest-ListServerFiltersTestJSON-515523146-project-member] Enqueued Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1725.840559] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9288720-d9f6-45b7-9a58-f770ce25595f with Priority: HIGHEST for action security_group_members [ 1725.840953] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9288720-d9f6-45b7-9a58-f770ce25595f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.841093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.841184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.841386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.841645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.841779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.841851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.842055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.842152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.842298] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9288720-d9f6-45b7-9a58-f770ce25595f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1725.966170] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44d2b42-149f-48e5-8058-356410e335af in Status: SUCCESS [ 1725.966382] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44d2b42-149f-48e5-8058-356410e335af deletion is rescheduled due to dependency. [ 1725.966502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1726.344524] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.344706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1726.344758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1726.344989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1726.345107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1726.345309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.345438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1726.345502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1726.345656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1726.345737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1726.345827] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f is going to be updated. [ 1726.373195] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.373195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1726.373195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1726.373195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1726.373195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1726.380988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: IN_PROGRESS for 2s [ 1727.298487] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1727.298805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.298873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.299091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.299276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.299394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1727.299459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.299612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.299693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.299789] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1727.801627] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1727.862477] env[71051]: INFO networking_nsxv3.common.synchronization [req-8ec328f3-ec2d-4649-ac87-1bcf1ea86f06 req-d8059bdd-bfe5-4936-aa35-dedfca42ea1f tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1727.863088] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1727.863435] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.863565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1727.863638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.864223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.864436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.864609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1727.864777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.864987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.865142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.865264] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.307114] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.367266] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.397172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9288720-d9f6-45b7-9a58-f770ce25595f in Status: SUCCESS [ 1728.397172] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9288720-d9f6-45b7-9a58-f770ce25595f deletion is rescheduled due to dependency. [ 1728.397172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9288720-d9f6-45b7-9a58-f770ce25595f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.809890] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.810114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1728.810412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1728.810481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1728.810551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.810647] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1728.843273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.843431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1728.843477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1728.843694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1728.843839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.854554] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1728.870059] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1729.155854] env[71051]: INFO networking_nsxv3.common.synchronization [req-744092b8-8437-4902-8eb3-8c5eebd83674 req-295f278f-3c54-49fc-96bb-826ed09cfd72 tempest-ImagesOneServerNegativeTestJSON-2119100416 tempest-ImagesOneServerNegativeTestJSON-2119100416-project-member] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1729.157510] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGHEST for action security_group_members [ 1729.157510] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.157704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.157789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.157991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.158172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.158271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.158330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.158482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.158565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.158659] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1729.373916] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.373916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.373916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.373916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.373916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.373916] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1729.401137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.402090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.402090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.402090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.402090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.411196] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1729.663028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.663028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.663028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.663486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.663486] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be updated. [ 1729.700358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.700358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1729.700536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1729.701356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1729.701356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1729.710022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: IN_PROGRESS for 2s [ 1730.864411] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1730.864725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1730.864843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1730.865075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1730.865267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.865386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1730.865448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1730.865594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1730.865670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1730.865753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1730.865901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.865991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1730.866083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1730.866241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1730.866359] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.866448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1730.866504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1730.866634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1730.866705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1730.866781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1730.866870] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1731.368874] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88000fa0-ad41-4e33-a474-dbc4d09cd427: rpc.has_security_group_logging(os_id): False [ 1731.386577] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.386734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.386734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.386940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.387062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.387269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.387373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.387452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.387592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.387669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.387958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.387958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.388085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.388163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.388236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.388435] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.388783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.388783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.388783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.388783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.388947] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be created. [ 1731.421585] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1731.421698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.462023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.462023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.462023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.462023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.462023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.473243] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1731.725624] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b in Status: SUCCESS [ 1731.725874] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b deletion is rescheduled due to dependency. [ 1731.726049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.282322] env[71051]: INFO networking_nsxv3.common.synchronization [req-9b81cb5f-6aaf-4c51-92f6-f44db5e71f8a req-84250bec-7136-4a12-a374-318e0b8cba42 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1733.282853] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1733.283216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.283346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.283412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.283606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.283764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.283858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.283917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.284357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.284357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.284357] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1733.485893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1733.485893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.485893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.485893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.485893] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1733.786553] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.786735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.786808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.787058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.787164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.787379] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.787623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.787623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.787775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.787806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.787951] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1733.817328] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.817503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.817576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.818113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.818113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.827036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1733.991517] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.991712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.991771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.991975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.992215] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.992448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.992448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.992604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.992675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.992848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.992928] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1734.132908] env[71051]: INFO networking_nsxv3.common.synchronization [req-6a7be736-22d9-406a-9345-de61dd104fbf req-35a57504-00cb-47a6-9588-e656c756cb39 tempest-ListImageFiltersTestJSON-1814967747 tempest-ListImageFiltersTestJSON-1814967747-project-member] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1734.133636] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGHEST for action security_group_members [ 1734.134100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.134100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.134100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.134328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.134493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.134917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.134917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.134917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.134917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.135115] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1734.495555] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.496163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.496163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.496163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.496564] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.496564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.496564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.496729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.496729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.496863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.497046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.497166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.497225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.497435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.497639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.497785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.497893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.498112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.498254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.498385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.498535] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1734.637136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.637369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.637639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.637724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.637857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.638135] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.638279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.638340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.638545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.639228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.639228] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be updated. [ 1734.665955] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.666148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.666237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.666657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.666757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.675721] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: IN_PROGRESS for 2s [ 1735.001317] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88000fa0-ad41-4e33-a474-dbc4d09cd427: rpc.has_security_group_logging(os_id): False [ 1735.018782] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1735.019443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1735.019443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1735.019443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1735.019618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1735.019881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1735.019881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1735.019881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1735.020051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1735.020171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1735.020429] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1735.020539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1735.020633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1735.020842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1735.020954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1735.021238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1735.021351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1735.021417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1735.021561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1735.021640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1735.021731] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1735.086322] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1735.087029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1735.087029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1735.087029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1735.087029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1735.099764] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1735.838217] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1735.838217] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 deletion is rescheduled due to dependency. [ 1735.838217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.037713] env[71051]: INFO networking_nsxv3.common.synchronization [req-006c1ed3-e603-4393-a21e-b5ae01f8c5d8 req-00b64714-975e-48cc-bc80-82ea56c236ba tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1736.037841] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1736.038154] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.038279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.038349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.038552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.038701] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.038798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.038860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.039013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.044508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.044629] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.351903] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.351903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.351903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.352194] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.352473] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.352645] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.352771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.353012] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.353211] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.353436] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1736.353556] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1736.353789] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1736.353789] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1736.353907] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1736.354024] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1736.354214] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1736.385791] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1736.385987] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1736.386177] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1736.386395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.386751] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.386965] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.387112] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.387458] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.387624] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.552939] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.685742] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 in Status: SUCCESS [ 1736.685742] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 deletion is rescheduled due to dependency. [ 1736.685742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.890417] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.890843] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.890843] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.891333] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.891453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.891614] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 not found, creating... [ 1736.892018] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.892347] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.892417] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.892713] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.892922] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.893460] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.893603] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.893802] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.894125] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.894330] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.894571] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 is going to be created. [ 1736.917589] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.917589] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.917818] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.917956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.918217] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.918453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.054768] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.113233] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1737.113717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.437042] env[71051]: INFO networking_nsxv3.common.synchronization [req-efa2d667-0126-4a19-aed7-ad963f772ee1 req-96f2716a-ae15-4330-81d4-0d499259ccaf tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1737.437042] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1737.437042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.437042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.437042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.438113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.438113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.438113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.438113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.438329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.438329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.438442] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.559262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.559262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.559262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.559262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.559262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.559262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1737.593949] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.594929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.595179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.595684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.595994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.609558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1737.662516] env[71051]: INFO networking_nsxv3.common.synchronization [req-006c1ed3-e603-4393-a21e-b5ae01f8c5d8 req-908bd195-01be-4858-a876-303525b1cd57 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1737.662719] env[71051]: INFO networking_nsxv3.common.synchronization [req-006c1ed3-e603-4393-a21e-b5ae01f8c5d8 req-908bd195-01be-4858-a876-303525b1cd57 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1737.662866] env[71051]: INFO networking_nsxv3.common.synchronization [req-006c1ed3-e603-4393-a21e-b5ae01f8c5d8 req-908bd195-01be-4858-a876-303525b1cd57 service nova] Enqueued Resource ID: 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 with Priority: HIGHEST for action port [ 1737.663130] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1737.663372] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1737.663372] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 with Priority: HIGHEST for action port [ 1737.664311] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.664440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.664532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.664770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.664860] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.665693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.665789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.665983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.666113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.666154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.666315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.666386] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.945888] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.945888] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.945888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.946571] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1738.039081] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.039252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.039326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1738.039550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1738.039692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1738.047336] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1738.169028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.169028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.169028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 with status ACTIVE [ 1738.169028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.169476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.169476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1738.169476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1738.169575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1738.169699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.169793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.169855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1738.170030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1738.170114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1738.170295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.170613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.170613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1738.170613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1738.170810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1738.170810] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29 is going to be updated. [ 1738.192281] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1738.192446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1738.192520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1738.192736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1738.192872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1738.193047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bc4c98b-d4dd-4b60-aa17-a0a0ad838d29" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1739.619019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1739.619365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1739.619518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1739.619741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1739.619941] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1739.620149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1739.620212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1739.620384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1739.620474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1739.620582] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1740.057636] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1740.057879] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1740.058041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1740.124160] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1740.626825] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1741.131167] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.131351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1741.131425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1741.131667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1741.131740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1741.131846] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1741.159983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.160149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1741.163555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1741.163555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1741.163555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1741.184760] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1742.664240] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1742.664529] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1743.195868] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1743.196101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.196260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.196478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.196671] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.196791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.196858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.197015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.197103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.197191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.197283] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.265287] env[71051]: INFO networking_nsxv3.common.synchronization [req-60723689-d4ad-4a07-84fb-0ebf1cf169c5 req-4adf427d-e4c8-4d0e-bc3c-2e9a7ef6fb06 tempest-ImagesNegativeTestJSON-1591031329 tempest-ImagesNegativeTestJSON-1591031329-project-member] Enqueued Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1743.265839] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1743.266164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.266295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.266365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.267026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.267026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.267026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.267026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.267235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.267235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.267235] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.708914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.708914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.708914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.709364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.709364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.709364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.709364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.709498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.709531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.709683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.709816] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.709939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.709979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.710133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.710267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.710355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.710413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.710553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.711119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.711119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.711119] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.773556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.773797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.773903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.774214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.774338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.774595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.774712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.774878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.774945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.775018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.775149] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e569e0-1641-4c92-94b3-6745ffb49070 already deleted. [ 1743.775296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.818720] env[71051]: INFO networking_nsxv3.common.synchronization [req-9ae1795b-09d0-44e3-a3e5-92600e57325b req-8779edae-e542-4dfc-a33f-8000d9b377d6 tempest-MigrationsAdminTest-1588746854 tempest-MigrationsAdminTest-1588746854-project-member] Enqueued Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1743.818720] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b with Priority: HIGHEST for action security_group_members [ 1743.818720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.818720] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.818720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.819347] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbb30ff-0400-4ec6-ade0-aa4c2a91880b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.863899] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.864358] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.864358] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.864614] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.864887] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.867802] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.868061] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.868328] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.868520] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.869195] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1743.869355] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1743.869523] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1743.869655] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1743.869777] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1743.869892] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1743.870049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1743.897273] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1743.897273] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1743.897273] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1743.897273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-157" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.897273] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-970c387d-58b7-48dc-bfa9-19a397f4533b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.897273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.897273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.897273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.898105] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('970c387d-58b7-48dc-bfa9-19a397f4533b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.213017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1744.230303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.230446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.230525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.230732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.230826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.231018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.231145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.231216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.231370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.231453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.231655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.235063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.235219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.235398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.235507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.235681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.235779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.235834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.235978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.239919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.239965] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1744.297550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.297702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.297772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.297976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.298138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.313266] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1744.324980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.325138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.325199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.325407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.325521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.325752] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.325876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.325955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.326135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.326216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.326306] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b is going to be updated. [ 1744.353657] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.353830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.353936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.354187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.354381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.362425] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: IN_PROGRESS for 2s [ 1744.401533] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.401770] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.401904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.402325] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.402518] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.402692] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 970c387d-58b7-48dc-bfa9-19a397f4533b not found, creating... [ 1744.402981] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.403201] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.403350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.403597] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.403748] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.404100] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.404305] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.404506] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.404800] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.405011] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.405222] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 970c387d-58b7-48dc-bfa9-19a397f4533b is going to be created. [ 1744.427928] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.428176] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.428308] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.428578] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.428811] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.429061] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.387806] env[71051]: INFO networking_nsxv3.common.synchronization [req-60723689-d4ad-4a07-84fb-0ebf1cf169c5 req-2b2897aa-20ca-4f23-931e-0ad34020735d service nova] Enqueued Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_rules [ 1745.388091] env[71051]: INFO networking_nsxv3.common.synchronization [req-60723689-d4ad-4a07-84fb-0ebf1cf169c5 req-2b2897aa-20ca-4f23-931e-0ad34020735d service nova] Enqueued Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1745.388184] env[71051]: INFO networking_nsxv3.common.synchronization [req-60723689-d4ad-4a07-84fb-0ebf1cf169c5 req-2b2897aa-20ca-4f23-931e-0ad34020735d service nova] Enqueued Resource ID: 970c387d-58b7-48dc-bfa9-19a397f4533b with Priority: HIGHEST for action port [ 1745.388834] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_rules [ 1745.388834] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1745.389057] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970c387d-58b7-48dc-bfa9-19a397f4533b with Priority: HIGHEST for action port [ 1745.389196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.389345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.389404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.389632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.389716] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.390919] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.391036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.391123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.391300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.391455] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.391553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.391617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.392039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.392150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.392246] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.393099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-970c387d-58b7-48dc-bfa9-19a397f4533b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.393217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.393309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.393540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.393540] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('970c387d-58b7-48dc-bfa9-19a397f4533b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.411464] env[71051]: INFO networking_nsxv3.common.synchronization [req-b7406e41-01f7-46f0-8879-11784b75198d req-89adf24a-5e23-4fff-9684-7d0af9b12465 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1745.412203] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1745.412713] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.413056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.413056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.413136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.413437] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.413437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.413437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.413667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.413667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.413767] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.705138] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.705138] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.705138] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.705138] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.705138] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.705653] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.705925] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.706290] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.706585] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.706952] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1745.707246] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1745.709494] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1745.709494] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1745.709494] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1745.709494] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1745.709494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1745.728185] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1745.728185] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1745.728185] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1745.728185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.728185] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-5db45ad3-e880-4094-af8e-e03f8a61666d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.728185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.728185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.728185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.728185] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db45ad3-e880-4094-af8e-e03f8a61666d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.896216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.896216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.903033] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.903033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 970c387d-58b7-48dc-bfa9-19a397f4533b with status ACTIVE [ 1745.903033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.903033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.903033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.903033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.903719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.903719] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 970c387d-58b7-48dc-bfa9-19a397f4533b is going to be updated. [ 1745.915702] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.916329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.916556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.916848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.917080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.917401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.917649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.917833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.918110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.918608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.918828] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1745.929293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.930331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.930331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.930331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.930331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.930653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-970c387d-58b7-48dc-bfa9-19a397f4533b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.943994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.944332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1745.946017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1745.946017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1745.946017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1745.952620] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1746.231053] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.232415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.232675] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.233133] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.234299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.234500] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 5db45ad3-e880-4094-af8e-e03f8a61666d not found, creating... [ 1746.234806] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.234974] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.235119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.235423] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.235624] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.235943] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.236123] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.236246] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.236531] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.236618] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.236765] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 5db45ad3-e880-4094-af8e-e03f8a61666d is going to be created. [ 1746.267558] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.267558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.267558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.267558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.267558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.267558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.331797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1746.332076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.373972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b in Status: SUCCESS [ 1746.374305] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbb30ff-0400-4ec6-ade0-aa4c2a91880b deletion is rescheduled due to dependency. [ 1746.374440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbb30ff-0400-4ec6-ade0-aa4c2a91880b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.409996] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1746.914221] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.914464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.914464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.914695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.915113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.915113] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e569e0-1641-4c92-94b3-6745ffb49070 is going to be created. [ 1746.936586] env[71051]: INFO networking_nsxv3.common.synchronization [req-b7406e41-01f7-46f0-8879-11784b75198d req-a2abe3ca-4ed6-482d-8d67-3b590b8c41f1 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1746.936826] env[71051]: INFO networking_nsxv3.common.synchronization [req-b7406e41-01f7-46f0-8879-11784b75198d req-a2abe3ca-4ed6-482d-8d67-3b590b8c41f1 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1746.936932] env[71051]: INFO networking_nsxv3.common.synchronization [req-b7406e41-01f7-46f0-8879-11784b75198d req-a2abe3ca-4ed6-482d-8d67-3b590b8c41f1 service nova] Enqueued Resource ID: 5db45ad3-e880-4094-af8e-e03f8a61666d with Priority: HIGHEST for action port [ 1746.938090] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.938217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.938283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.938483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.938631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.939582] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1746.939708] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1746.939798] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db45ad3-e880-4094-af8e-e03f8a61666d with Priority: HIGHEST for action port [ 1746.940387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.940494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.940556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.940714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.940796] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1746.942839] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.942943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.943299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db45ad3-e880-4094-af8e-e03f8a61666d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.943429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.943497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.943661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.943740] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db45ad3-e880-4094-af8e-e03f8a61666d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1746.952483] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: UNINITIALIZED for 2s [ 1747.368347] env[71051]: INFO networking_nsxv3.common.synchronization [None req-4c9c6f6e-a81f-416f-ae1e-cc7502a6e6d2 None None] Enqueued Resource ID: eff48705-332d-47cb-815e-d1d713d11f07 with Priority: HIGHEST for action port [ 1747.368347] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff48705-332d-47cb-815e-d1d713d11f07 with Priority: HIGHEST for action port [ 1747.368882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-eff48705-332d-47cb-815e-d1d713d11f07 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.369054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eff48705-332d-47cb-815e-d1d713d11f07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.369098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eff48705-332d-47cb-815e-d1d713d11f07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.369325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eff48705-332d-47cb-815e-d1d713d11f07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.369404] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eff48705-332d-47cb-815e-d1d713d11f07',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1747.444621] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.444904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.445753] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db45ad3-e880-4094-af8e-e03f8a61666d with status ACTIVE [ 1747.445753] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.445753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.445753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.445753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.446200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.448449] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.448449] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.448449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.448449] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db45ad3-e880-4094-af8e-e03f8a61666d is going to be updated. [ 1747.470680] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.470959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.470959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.472376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.472818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.472818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db45ad3-e880-4094-af8e-e03f8a61666d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.755294] env[71051]: INFO networking_nsxv3.common.synchronization [req-6339381c-c5e1-4009-8e44-35c28580b630 req-850a1754-d284-4152-ae81-5f6d9ebe72a1 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1747.758139] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1747.758139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.758139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.758139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.758139] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1747.871958] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eff48705-332d-47cb-815e-d1d713d11f07 [ 1747.872231] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.872386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.872460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.872684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.872778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.872874] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eff48705-332d-47cb-815e-d1d713d11f07 already deleted. [ 1747.872957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eff48705-332d-47cb-815e-d1d713d11f07" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.935119] env[71051]: INFO networking_nsxv3.common.synchronization [req-fb6697a3-e3b3-4576-b9ea-68a2abc75ebc req-9381a02f-7d9c-4902-9b23-7b383a21c401 tempest-SecurityGroupRulesNegativeTestJSON-1515573081 tempest-SecurityGroupRulesNegativeTestJSON-1515573081-project-member] Enqueued Resource ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 with Priority: HIGHEST for action security_group_rules [ 1747.935667] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 with Priority: HIGHEST for action security_group_rules [ 1747.935967] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.936103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.936172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.936431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.936513] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5f1991-17ab-4406-bd07-e6c4d582bb71',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1747.961797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1747.962200] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.965652] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.965652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.965652] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.159390] env[71051]: INFO networking_nsxv3.common.synchronization [req-af0a73a7-2694-472d-97c3-990ce7e3917b req-e292195d-3d71-4571-84c9-bce7adc75e76 tempest-SecurityGroupRulesNegativeTestJSON-1515573081 tempest-SecurityGroupRulesNegativeTestJSON-1515573081-project-member] Enqueued Resource ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 with Priority: HIGHEST for action security_group_rules [ 1748.162578] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 with Priority: HIGHEST for action security_group_rules [ 1748.163018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.163191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.260453] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.461641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.461641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 already deleted. [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.461641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.461641] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5f1991-17ab-4406-bd07-e6c4d582bb71',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.470013] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.764822] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.962763] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: SUCCESS [ 1748.963095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.964177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.964393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.964587] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.964704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.964766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.964920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.965012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.965105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.965209] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.974647] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.000288] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.000288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.000288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.000288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.000288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.000288] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5f1991-17ab-4406-bd07-e6c4d582bb71 already deleted. [ 1749.000288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5f1991-17ab-4406-bd07-e6c4d582bb71" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.269645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.269645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.269645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.269645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.269645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.269645] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1749.321751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.322264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.322790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.323833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.324010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.333848] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1749.467825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.468142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.468142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.468368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.468570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.468691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.468770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.468952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.469081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.469198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.469381] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.469503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.469584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.469761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.469922] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.470042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.470122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.470305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.470415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.470520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.470638] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.476497] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.476615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.476693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.476860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.476944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.477053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1749.504810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.504954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.505039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.505262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.505412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.516880] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1749.820109] env[71051]: INFO networking_nsxv3.common.synchronization [None req-45d971e9-e1ed-45f0-ac23-01c039f7e3b8 None None] Enqueued Resource ID: 58c3d12e-2505-44f3-a7c9-19524cf3bf3b with Priority: HIGHEST for action port [ 1749.820109] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58c3d12e-2505-44f3-a7c9-19524cf3bf3b with Priority: HIGHEST for action port [ 1749.820109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-58c3d12e-2505-44f3-a7c9-19524cf3bf3b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.820109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58c3d12e-2505-44f3-a7c9-19524cf3bf3b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.820109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58c3d12e-2505-44f3-a7c9-19524cf3bf3b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.820109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58c3d12e-2505-44f3-a7c9-19524cf3bf3b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.820109] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58c3d12e-2505-44f3-a7c9-19524cf3bf3b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.975562] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4e569e0-1641-4c92-94b3-6745ffb49070: rpc.has_security_group_logging(os_id): False [ 1749.996544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.996679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.996750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.996976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.997097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.997321] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.997416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.997477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.997651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.997708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.997879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.997967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.998107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.998174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.998251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.998426] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.998547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.998583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.000048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.000048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.000048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4e569e0-1641-4c92-94b3-6745ffb49070 is going to be created. [ 1750.058304] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.058441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.062030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.062030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.062030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.068160] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: IN_PROGRESS for 2s [ 1750.324436] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58c3d12e-2505-44f3-a7c9-19524cf3bf3b [ 1750.325887] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.325887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.325887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.325887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.325887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.325887] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58c3d12e-2505-44f3-a7c9-19524cf3bf3b already deleted. [ 1750.325887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58c3d12e-2505-44f3-a7c9-19524cf3bf3b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.385831] env[71051]: INFO networking_nsxv3.common.synchronization [req-b9c44ae9-d9b5-4117-a247-25d08b145982 req-e13ece9b-f6e3-4ab5-ae11-12001e2bc67c tempest-ServerActionsV293TestJSON-1541438298 tempest-ServerActionsV293TestJSON-1541438298-project-member] Enqueued Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1750.385831] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 with Priority: HIGHEST for action security_group_members [ 1750.386205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efbdb84-0e00-421d-96e9-16064575b3b4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.387706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.387947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.388419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.388763] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.390694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.390694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.390694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.390694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.390694] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efbdb84-0e00-421d-96e9-16064575b3b4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1750.892043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.892335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.892335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.892495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.913282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.913561] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.913681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.913760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.913949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.915259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.916509] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 is going to be updated. [ 1750.941893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1750.942069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1750.942136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1750.942344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1750.942492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1750.952244] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: IN_PROGRESS for 2s [ 1751.345937] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1751.346193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.527322] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1751.527540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.527954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1751.528280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1751.528431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1751.528499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1751.528537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1751.528680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1751.528765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.528850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.528938] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.030932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.034025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.034025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.034025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.034025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.035221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.035221] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.082412] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: SUCCESS [ 1752.082412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.459695] env[71051]: INFO networking_nsxv3.common.synchronization [req-7fa95bc4-5531-4b79-9187-685871a784b9 req-57cd14ca-098e-447f-8995-0cbbc65b905d tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1752.460211] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1752.460550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.460675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.460744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.461718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.461893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.462018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.462087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.462528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.462528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.462528] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.538019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1752.556827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.556989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.557063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.557347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.557421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.557589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.557684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.557749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.557900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.557981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.558623] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.558752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.558831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.559906] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.559906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.560260] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1752.620894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.621133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.621133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.621633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.621633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.634257] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1752.960028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 in Status: SUCCESS [ 1752.960224] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efbdb84-0e00-421d-96e9-16064575b3b4 deletion is rescheduled due to dependency. [ 1752.962725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efbdb84-0e00-421d-96e9-16064575b3b4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.965023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.965164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.965247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.965432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.965519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.965850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.966032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.966194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.966261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.966340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.966464] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 already deleted. [ 1752.967707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.038024] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.038024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.038024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.038514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.038551] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.038724] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.038846] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.039084] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.039271] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.039455] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1753.039576] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1753.039688] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1753.039801] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1753.040095] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1753.040095] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1753.040197] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1753.067081] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1753.067384] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1753.067552] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1753.067736] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-34" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.068109] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.068264] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.068411] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.068738] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.068887] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bce5f54-0bee-4f75-9d16-1983c91cf1a7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.573300] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.573639] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.573810] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.574140] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.576133] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.576366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 not found, creating... [ 1753.576715] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.576956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.577130] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.577409] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.577604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.578215] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.580265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.580486] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.580752] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.580909] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.581122] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 is going to be created. [ 1753.606035] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.606373] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1753.606582] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1753.606940] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1753.608664] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.609478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.444410] env[71051]: INFO networking_nsxv3.common.synchronization [req-7fa95bc4-5531-4b79-9187-685871a784b9 req-cbf405e0-6da4-4853-b8f2-cb0ad44e7978 service nova] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1754.444686] env[71051]: INFO networking_nsxv3.common.synchronization [req-7fa95bc4-5531-4b79-9187-685871a784b9 req-cbf405e0-6da4-4853-b8f2-cb0ad44e7978 service nova] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1754.444796] env[71051]: INFO networking_nsxv3.common.synchronization [req-7fa95bc4-5531-4b79-9187-685871a784b9 req-cbf405e0-6da4-4853-b8f2-cb0ad44e7978 service nova] Enqueued Resource ID: 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 with Priority: HIGHEST for action port [ 1754.444963] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_rules [ 1754.445111] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1754.445207] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 with Priority: HIGHEST for action port [ 1754.445778] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.445909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.445978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.447990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.448093] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.450239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.450359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.450430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.450620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.450764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.451023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.451023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.451154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.451154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.451256] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.452301] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.452445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.452486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.452615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.452688] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bce5f54-0bee-4f75-9d16-1983c91cf1a7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.649845] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1754.650267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.951190] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.953159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.955782] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.958238] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 with status ACTIVE [ 1754.958238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.958238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.958238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.958238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.958925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.958925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.958925] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bce5f54-0bee-4f75-9d16-1983c91cf1a7 is going to be updated. [ 1754.978907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.978907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.978907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.979118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.981379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.981379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bce5f54-0bee-4f75-9d16-1983c91cf1a7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.460905] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.689923] env[71051]: INFO networking_nsxv3.common.synchronization [None req-84acd329-0a5e-4677-96b7-45b2ceaba276 None None] Enqueued Resource ID: 1bd02db2-b47e-4523-bd3f-d116d70b7658 with Priority: HIGHEST for action port [ 1755.690648] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd02db2-b47e-4523-bd3f-d116d70b7658 with Priority: HIGHEST for action port [ 1755.692571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bd02db2-b47e-4523-bd3f-d116d70b7658 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.692571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bd02db2-b47e-4523-bd3f-d116d70b7658" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.692571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bd02db2-b47e-4523-bd3f-d116d70b7658" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.692571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bd02db2-b47e-4523-bd3f-d116d70b7658" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.692571] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd02db2-b47e-4523-bd3f-d116d70b7658',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.963505] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.964318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.964421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.964650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.964749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.964850] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 is going to be created. [ 1755.989313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.989471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.989545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.989760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.989932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.999752] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: UNINITIALIZED for 2s [ 1756.197420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bd02db2-b47e-4523-bd3f-d116d70b7658 [ 1756.197420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.197420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1756.197420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1756.197420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1756.197420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1756.197420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bd02db2-b47e-4523-bd3f-d116d70b7658 already deleted. [ 1756.197420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bd02db2-b47e-4523-bd3f-d116d70b7658" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1757.186931] env[71051]: INFO networking_nsxv3.common.synchronization [req-da5fd712-0408-4eb8-82c5-c5c108615b92 req-d1b5d85d-2972-4bd6-a653-bb64836bd933 tempest-ImagesNegativeTestJSON-1591031329 tempest-ImagesNegativeTestJSON-1591031329-project-member] Enqueued Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1757.187581] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e569e0-1641-4c92-94b3-6745ffb49070 with Priority: HIGHEST for action security_group_members [ 1757.187959] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e569e0-1641-4c92-94b3-6745ffb49070 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.191010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.191098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.191336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.191511] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.192220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.192220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.192220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.192220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1757.192220] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e569e0-1641-4c92-94b3-6745ffb49070',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1757.694703] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.695213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.695337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.696353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.696514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1757.696818] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.696983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.697093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.697454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.697566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1757.697733] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e569e0-1641-4c92-94b3-6745ffb49070 is going to be updated. [ 1757.732033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.732179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.732252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.732545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.732823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1757.740751] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: IN_PROGRESS for 2s [ 1757.947033] env[71051]: INFO networking_nsxv3.common.synchronization [None req-ea706429-0a8b-4f69-bc3f-b181f0d44834 None None] Enqueued Resource ID: 7e5f7938-d662-4e69-81a2-de4cf78e45ca with Priority: HIGHEST for action port [ 1757.947715] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5f7938-d662-4e69-81a2-de4cf78e45ca with Priority: HIGHEST for action port [ 1757.948024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5f7938-d662-4e69-81a2-de4cf78e45ca taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.948153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5f7938-d662-4e69-81a2-de4cf78e45ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.948215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5f7938-d662-4e69-81a2-de4cf78e45ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.948507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5f7938-d662-4e69-81a2-de4cf78e45ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.948596] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5f7938-d662-4e69-81a2-de4cf78e45ca',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1758.009126] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: SUCCESS [ 1758.009361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.009518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1758.010202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1758.010202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1758.010202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1758.010394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1758.010394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1758.010466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.010623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.010721] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1758.453442] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e5f7938-d662-4e69-81a2-de4cf78e45ca [ 1758.453757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1758.453852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1758.453905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1758.454169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1758.454236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.454316] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e5f7938-d662-4e69-81a2-de4cf78e45ca already deleted. [ 1758.454406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5f7938-d662-4e69-81a2-de4cf78e45ca" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.513131] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1758.897684] env[71051]: INFO networking_nsxv3.common.synchronization [req-8e3e0fb8-d5eb-4fb6-ba43-57f7712d02ef req-76ad772b-c53e-446f-b0b9-a7c3ad4c516b tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1758.899033] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1758.899033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1758.900061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1758.900408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1758.900674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1758.900884] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1758.901009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1758.901545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1758.901783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1758.901921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1758.902067] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1759.015857] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 806528ce-4973-42fd-b251-c3e1d4458d10: rpc.has_security_group_logging(os_id): False [ 1759.032431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.032580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.032653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.032869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.032966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.033352] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.033475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.033540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.033699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.033780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.033887] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 is going to be created. [ 1759.095716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.095943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.096032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.096244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.096452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.107535] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: IN_PROGRESS for 2s [ 1759.409222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.409222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.409222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.409365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.409505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.409729] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.409821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.409871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.410375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.410375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.410375] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1759.443783] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.443783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.443783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.443783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.443783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.450348] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1759.750530] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e569e0-1641-4c92-94b3-6745ffb49070 in Status: SUCCESS [ 1759.751600] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e569e0-1641-4c92-94b3-6745ffb49070 deletion is rescheduled due to dependency. [ 1759.752875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e569e0-1641-4c92-94b3-6745ffb49070" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1760.701939] env[71051]: INFO networking_nsxv3.common.synchronization [req-cfbb233d-deca-48dd-b637-1ae405c61a48 req-cc74b464-3a5b-4ac8-bb5e-6e3db70e0f7b tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1760.702437] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1760.702743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1760.702875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1760.702940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1760.705282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1760.705470] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1760.705584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1760.705681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1760.706148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1760.706148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1760.706148] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1761.121737] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: SUCCESS [ 1761.121988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1761.211788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1761.211932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1761.212029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1761.212444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1761.212630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1761.212886] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1761.212995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1761.213683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1761.213683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1761.213683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1761.213683] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1761.241895] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1761.242063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1761.242147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1761.242365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1761.242507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1761.260276] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1761.463312] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1761.463524] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1761.463674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1763.270655] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1763.270900] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1763.270973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1763.497272] env[71051]: INFO networking_nsxv3.common.synchronization [req-25d642ac-f566-4616-ba0c-8dfd4079e852 req-617a27ae-8b4d-4009-94a9-de1920d1e919 tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1763.497898] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1763.499464] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.499574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.499654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.501131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.501131] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.501131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.501131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.501131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.501131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1763.501131] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.887151] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1c84b6d5-4b2f-43f7-bedc-656f9fc6b968 None None] Enqueued Resource ID: 64784db3-99bc-4ff9-8666-97a931e13fbb with Priority: HIGHEST for action port [ 1763.887542] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64784db3-99bc-4ff9-8666-97a931e13fbb with Priority: HIGHEST for action port [ 1763.888040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-64784db3-99bc-4ff9-8666-97a931e13fbb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.888226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64784db3-99bc-4ff9-8666-97a931e13fbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.888226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64784db3-99bc-4ff9-8666-97a931e13fbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.888433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64784db3-99bc-4ff9-8666-97a931e13fbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.888489] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64784db3-99bc-4ff9-8666-97a931e13fbb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.003247] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.081379] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.081379] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.081379] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.081622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.081843] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.084065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.084065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.084065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.084065] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.084065] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1764.084065] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1764.084065] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1764.084065] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1764.084065] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1764.084577] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1764.084645] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1764.104607] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1764.104750] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1764.104903] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1764.106125] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.106533] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.106739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.106872] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.107239] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.107461] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272a7516-f5f5-43d0-ad95-435cb5b9bbfc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.392061] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64784db3-99bc-4ff9-8666-97a931e13fbb [ 1764.392061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.392061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.392061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.392484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.392484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.392484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64784db3-99bc-4ff9-8666-97a931e13fbb already deleted. [ 1764.392484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64784db3-99bc-4ff9-8666-97a931e13fbb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.507161] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.610659] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.614037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 272a7516-f5f5-43d0-ad95-435cb5b9bbfc not found, creating... [ 1764.614037] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.614037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.614415] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.614415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.614415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.614990] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.615299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.615676] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 272a7516-f5f5-43d0-ad95-435cb5b9bbfc is going to be created. [ 1764.639038] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.639471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.639658] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.640114] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.640225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.640546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.856559] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3627c546-f9e9-4aa3-9df8-c85f93189222 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1764.856559] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1764.856559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.856559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.856559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.856559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.856559] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.900369] env[71051]: INFO networking_nsxv3.common.synchronization [None req-13f9d501-5e21-4e84-9706-518099a5107e None None] Enqueued Resource ID: be2d9439-5eb5-4bb6-9f84-0286e14af5c1 with Priority: HIGHEST for action port [ 1764.901200] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be2d9439-5eb5-4bb6-9f84-0286e14af5c1 with Priority: HIGHEST for action port [ 1764.902727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-be2d9439-5eb5-4bb6-9f84-0286e14af5c1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.902727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be2d9439-5eb5-4bb6-9f84-0286e14af5c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.902727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be2d9439-5eb5-4bb6-9f84-0286e14af5c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.902983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be2d9439-5eb5-4bb6-9f84-0286e14af5c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.903089] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be2d9439-5eb5-4bb6-9f84-0286e14af5c1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.937252] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c81138f3-c974-4ce5-90a8-782073c687e1 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1764.937742] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1764.938570] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.938666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.011911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.012099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.012218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.012492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.012591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.012698] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1765.041027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.041813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.041813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.041813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.041813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.050932] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1765.379048] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.379048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 already deleted. [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.379048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.379048] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1765.407854] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be2d9439-5eb5-4bb6-9f84-0286e14af5c1 [ 1765.407854] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.407854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.407854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.407854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.407854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.407854] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be2d9439-5eb5-4bb6-9f84-0286e14af5c1 already deleted. [ 1765.407854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be2d9439-5eb5-4bb6-9f84-0286e14af5c1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.616364] env[71051]: INFO networking_nsxv3.common.synchronization [req-25d642ac-f566-4616-ba0c-8dfd4079e852 req-4b8ce79a-e597-47a4-a786-948220dc00f7 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1765.616456] env[71051]: INFO networking_nsxv3.common.synchronization [req-25d642ac-f566-4616-ba0c-8dfd4079e852 req-4b8ce79a-e597-47a4-a786-948220dc00f7 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1765.616753] env[71051]: INFO networking_nsxv3.common.synchronization [req-25d642ac-f566-4616-ba0c-8dfd4079e852 req-4b8ce79a-e597-47a4-a786-948220dc00f7 service nova] Enqueued Resource ID: 272a7516-f5f5-43d0-ad95-435cb5b9bbfc with Priority: HIGHEST for action port [ 1765.616884] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1765.617108] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1765.617108] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272a7516-f5f5-43d0-ad95-435cb5b9bbfc with Priority: HIGHEST for action port [ 1765.617666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.617792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.618053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.619474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.619596] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1765.621276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.621435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.622120] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.622290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.622536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.622536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.622657] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272a7516-f5f5-43d0-ad95-435cb5b9bbfc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1765.908275] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.908485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.908485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.908764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.908816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.908864] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 already deleted. [ 1765.908949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.081017] env[71051]: INFO networking_nsxv3.common.synchronization [req-39175503-66f4-4799-9a88-696a97d363bb req-1799cc68-756e-4319-9b57-b7119f9a0b13 tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: 7f909912-a3fc-498d-9dc4-9742107fbbfa with Priority: HIGHEST for action security_group_rules [ 1766.081017] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f909912-a3fc-498d-9dc4-9742107fbbfa with Priority: HIGHEST for action security_group_rules [ 1766.081017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f909912-a3fc-498d-9dc4-9742107fbbfa taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.081017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f909912-a3fc-498d-9dc4-9742107fbbfa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.081017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f909912-a3fc-498d-9dc4-9742107fbbfa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.081017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f909912-a3fc-498d-9dc4-9742107fbbfa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.081017] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f909912-a3fc-498d-9dc4-9742107fbbfa',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1766.125414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.125414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.125414] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 272a7516-f5f5-43d0-ad95-435cb5b9bbfc with status ACTIVE [ 1766.125414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.125414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.125414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.125655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.125709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.126031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.126031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.126031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.126264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.126571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.126571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.126692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.126787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.127027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.127027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.127166] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 272a7516-f5f5-43d0-ad95-435cb5b9bbfc is going to be updated. [ 1766.144493] env[71051]: INFO networking_nsxv3.common.synchronization [req-6ee6f64a-1fa8-40e0-86ff-33edfbbad49e req-082c0dd6-7d6f-4273-8048-28ce89bd6085 tempest-ServersTestBootFromVolume-2134801246 tempest-ServersTestBootFromVolume-2134801246-project-member] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1766.146020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGHEST for action security_group_members [ 1766.148222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.148222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.148222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.148222] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1766.158035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.158170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.158249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.158440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.158574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.158725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-272a7516-f5f5-43d0-ad95-435cb5b9bbfc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.254687] env[71051]: INFO networking_nsxv3.common.synchronization [None req-6e55b1d2-82b0-41be-8f16-52543fb12bcb None None] Enqueued Resource ID: 0baebd30-d34b-4ce8-a858-396ea32aa068 with Priority: HIGHEST for action port [ 1766.255248] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baebd30-d34b-4ce8-a858-396ea32aa068 with Priority: HIGHEST for action port [ 1766.256313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0baebd30-d34b-4ce8-a858-396ea32aa068 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.257091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0baebd30-d34b-4ce8-a858-396ea32aa068" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.257091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0baebd30-d34b-4ce8-a858-396ea32aa068" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.257091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0baebd30-d34b-4ce8-a858-396ea32aa068" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.257091] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0baebd30-d34b-4ce8-a858-396ea32aa068',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1766.600941] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.601300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.601300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.601413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.601462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.601562] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f909912-a3fc-498d-9dc4-9742107fbbfa already deleted. [ 1766.601649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f909912-a3fc-498d-9dc4-9742107fbbfa" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.654102] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.654320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.654584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.654584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.654688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.654899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.655481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.655481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.655481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.655481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.655702] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 is going to be updated. [ 1766.689093] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.689218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.689264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.689831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.689831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.698827] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: IN_PROGRESS for 2s [ 1766.761663] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0baebd30-d34b-4ce8-a858-396ea32aa068 [ 1766.761663] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.761663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.761663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.761663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.761663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.761663] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0baebd30-d34b-4ce8-a858-396ea32aa068 already deleted. [ 1766.761663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0baebd30-d34b-4ce8-a858-396ea32aa068" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.969555] env[71051]: INFO networking_nsxv3.common.synchronization [req-78f103ab-dad2-48ba-9df6-df751f2cb456 req-07cde721-f7fb-4929-9b0e-11f27b60d120 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1766.971204] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1766.973539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.973539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.973539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.973744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.973788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.973894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.973951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.974745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.974745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.974745] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.065214] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1767.066149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.066149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.066149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.066149] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.066447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.066447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.066548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.066593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.068016] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.347385] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.347385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.347385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.347385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.347385] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.348373] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.348775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.349319] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.349681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.352133] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1767.352133] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1767.352133] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1767.352133] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1767.352133] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1767.352133] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1767.352133] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1767.369778] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1767.372023] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1767.372023] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1767.372023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.372023] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-742db58e-0c56-4da0-b1f3-8b0450b48e40 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.372023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.372023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.372023] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.372023] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742db58e-0c56-4da0-b1f3-8b0450b48e40',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.448513] env[71051]: INFO networking_nsxv3.common.synchronization [req-b0fd5483-d354-4ec3-8298-68c47c122c22 req-902b1918-3854-4e82-8c08-bfcfa19095ab tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: f24c4d76-2f7a-48b2-af4d-35825b0d0235 with Priority: HIGHEST for action security_group_rules [ 1767.448513] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24c4d76-2f7a-48b2-af4d-35825b0d0235 with Priority: HIGHEST for action security_group_rules [ 1767.448513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f24c4d76-2f7a-48b2-af4d-35825b0d0235 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.448513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f24c4d76-2f7a-48b2-af4d-35825b0d0235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.448513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f24c4d76-2f7a-48b2-af4d-35825b0d0235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.449404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f24c4d76-2f7a-48b2-af4d-35825b0d0235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.449625] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f24c4d76-2f7a-48b2-af4d-35825b0d0235',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.474915] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a491ceb4-1b6c-40d8-9020-ad5eee0f4ccc None None] Enqueued Resource ID: 3b37f4ba-24a5-4f32-8526-382ca52daa10 with Priority: HIGHEST for action port [ 1767.475205] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b37f4ba-24a5-4f32-8526-382ca52daa10 with Priority: HIGHEST for action port [ 1767.475739] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b37f4ba-24a5-4f32-8526-382ca52daa10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.475860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b37f4ba-24a5-4f32-8526-382ca52daa10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.477019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b37f4ba-24a5-4f32-8526-382ca52daa10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.477019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b37f4ba-24a5-4f32-8526-382ca52daa10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.477019] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b37f4ba-24a5-4f32-8526-382ca52daa10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.480237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.480356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.480459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.480608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.480695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.480879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.480974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.481043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.481189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.481263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.481347] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1767.507638] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.507638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.507638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.507638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.507638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.513045] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1767.575162] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.877131] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.877131] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.877131] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.877442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.877442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.877691] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 742db58e-0c56-4da0-b1f3-8b0450b48e40 not found, creating... [ 1767.879533] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.879533] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.879533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.879899] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.879899] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 742db58e-0c56-4da0-b1f3-8b0450b48e40 is going to be created. [ 1767.902227] env[71051]: INFO networking_nsxv3.common.synchronization [req-72b9b3cd-47aa-4e41-b948-cc94d360b26a req-850e4eed-b4f6-4f19-8d2f-08b208f78ec9 tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: d059b5d8-b3e7-49ae-86d0-51c12d86ed50 with Priority: HIGHEST for action security_group_rules [ 1767.903451] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.903662] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.903790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.904160] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.904337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.904628] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.905708] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d059b5d8-b3e7-49ae-86d0-51c12d86ed50 with Priority: HIGHEST for action security_group_rules [ 1767.905907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d059b5d8-b3e7-49ae-86d0-51c12d86ed50 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.906485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d059b5d8-b3e7-49ae-86d0-51c12d86ed50" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.906485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d059b5d8-b3e7-49ae-86d0-51c12d86ed50" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.906485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d059b5d8-b3e7-49ae-86d0-51c12d86ed50" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.906485] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d059b5d8-b3e7-49ae-86d0-51c12d86ed50',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1767.970556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.970712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.970786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.971014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.971114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.971221] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f24c4d76-2f7a-48b2-af4d-35825b0d0235 already deleted. [ 1767.971332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f24c4d76-2f7a-48b2-af4d-35825b0d0235" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.978211] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b37f4ba-24a5-4f32-8526-382ca52daa10 [ 1767.978927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1767.978927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1767.978927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1767.978927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1767.978927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1767.979234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b37f4ba-24a5-4f32-8526-382ca52daa10 already deleted. [ 1767.979234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b37f4ba-24a5-4f32-8526-382ca52daa10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.078473] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1768.426798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.426798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.426798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.427123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.427123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.427262] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d059b5d8-b3e7-49ae-86d0-51c12d86ed50 already deleted. [ 1768.427262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d059b5d8-b3e7-49ae-86d0-51c12d86ed50" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.496215] env[71051]: INFO networking_nsxv3.common.synchronization [req-973d189d-25aa-46f3-92dc-f0a430bf4d3d req-3d1e5386-0909-4178-b31c-561c80293f9a tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: afa704c1-2a43-45e7-85f9-6db440af8de0 with Priority: HIGHEST for action security_group_rules [ 1768.496778] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa704c1-2a43-45e7-85f9-6db440af8de0 with Priority: HIGHEST for action security_group_rules [ 1768.497251] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afa704c1-2a43-45e7-85f9-6db440af8de0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.497415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afa704c1-2a43-45e7-85f9-6db440af8de0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.499023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afa704c1-2a43-45e7-85f9-6db440af8de0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.499023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afa704c1-2a43-45e7-85f9-6db440af8de0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.499023] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afa704c1-2a43-45e7-85f9-6db440af8de0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1768.580870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.581047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.581295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.581562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.581695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.581830] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1768.612071] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.612071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.612071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.612071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.612071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.619092] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1768.639401] env[71051]: INFO networking_nsxv3.common.synchronization [req-78f103ab-dad2-48ba-9df6-df751f2cb456 req-ec397ca0-2027-454a-a381-d9703cd3d144 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1768.640014] env[71051]: INFO networking_nsxv3.common.synchronization [req-78f103ab-dad2-48ba-9df6-df751f2cb456 req-ec397ca0-2027-454a-a381-d9703cd3d144 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1768.641284] env[71051]: INFO networking_nsxv3.common.synchronization [req-78f103ab-dad2-48ba-9df6-df751f2cb456 req-ec397ca0-2027-454a-a381-d9703cd3d144 service nova] Enqueued Resource ID: 742db58e-0c56-4da0-b1f3-8b0450b48e40 with Priority: HIGHEST for action port [ 1768.641284] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1768.641753] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1768.642318] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 742db58e-0c56-4da0-b1f3-8b0450b48e40 with Priority: HIGHEST for action port [ 1768.644399] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.644399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.644399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.644399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.644399] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1768.645479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.645570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.645744] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-742db58e-0c56-4da0-b1f3-8b0450b48e40 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1768.645859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1768.646217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1768.646217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1768.646217] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742db58e-0c56-4da0-b1f3-8b0450b48e40',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1768.709268] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 in Status: SUCCESS [ 1768.709268] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 deletion is rescheduled due to dependency. [ 1768.709268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.018512] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.018793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.018793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.018930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.019027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.019124] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afa704c1-2a43-45e7-85f9-6db440af8de0 already deleted. [ 1769.019230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afa704c1-2a43-45e7-85f9-6db440af8de0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.030483] env[71051]: INFO networking_nsxv3.common.synchronization [req-65ef765c-b33f-4845-8980-696c67ec52d9 req-5bdfb29c-afd0-4e4d-845a-76273438f3ea tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.031055] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.031407] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53546ff3-ae6c-4038-97c9-df35a40950eb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.031531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.031600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.031840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.031925] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53546ff3-ae6c-4038-97c9-df35a40950eb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1769.148355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.148608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.150790] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 742db58e-0c56-4da0-b1f3-8b0450b48e40 with status ACTIVE [ 1769.150967] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.151094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.152133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.152133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.152464] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.152464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.152464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.152579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.152661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.152744] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 742db58e-0c56-4da0-b1f3-8b0450b48e40 is going to be updated. [ 1769.171857] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.172045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.172103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.172280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.172420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.172588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-742db58e-0c56-4da0-b1f3-8b0450b48e40" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.212450] env[71051]: INFO networking_nsxv3.common.synchronization [req-4cf2cdb1-01da-4749-bea4-462e9521fedd req-cf0cc505-1253-4cc0-9d08-37696146a547 tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.213092] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.213510] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53546ff3-ae6c-4038-97c9-df35a40950eb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.213643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.476504] env[71051]: INFO networking_nsxv3.common.synchronization [req-68b2b528-1225-4298-bc18-71eeb99247e0 req-32fae7b0-61f1-4199-a1ae-94186cd3c540 tempest-SecurityGroupRulesTestJSON-2063173581 tempest-SecurityGroupRulesTestJSON-2063173581-project-member] Enqueued Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.476974] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53546ff3-ae6c-4038-97c9-df35a40950eb with Priority: HIGHEST for action security_group_rules [ 1769.477295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53546ff3-ae6c-4038-97c9-df35a40950eb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.477448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.521832] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1769.522062] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1769.522175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.522341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.523236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.523236] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.523236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.523236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.523236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.523236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.523236] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1769.550202] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1769.550562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1769.550731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.551056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.551255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.551443] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53546ff3-ae6c-4038-97c9-df35a40950eb already deleted. [ 1769.551626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1769.552455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1769.552455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1769.552455] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53546ff3-ae6c-4038-97c9-df35a40950eb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1770.028705] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1770.076810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.076810] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53546ff3-ae6c-4038-97c9-df35a40950eb already deleted. [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1770.076810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1770.076810] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53546ff3-ae6c-4038-97c9-df35a40950eb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1770.531792] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1770.597579] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1770.597670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1770.597744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1770.598027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1770.598143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.598247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53546ff3-ae6c-4038-97c9-df35a40950eb already deleted. [ 1770.598337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53546ff3-ae6c-4038-97c9-df35a40950eb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.628490] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1770.628838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.630307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1770.630307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1770.630307] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1770.630307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1770.630587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1770.630587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1770.630587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.631020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.631194] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1771.033636] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.033636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.033636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.034079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.034079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.034079] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1771.059523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.059749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.059749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.059941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.060099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.067532] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1771.137162] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.137388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.137388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.137704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.137893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.138011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.138082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.138250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.138341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.138438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.138711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.138711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.138877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.138920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.139084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.139194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.139255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.139397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.139500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.139585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.139675] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1771.642258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88000fa0-ad41-4e33-a474-dbc4d09cd427: rpc.has_security_group_logging(os_id): False [ 1771.671479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.671691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.671767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.671983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.672273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.672492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.672597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.672662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.673014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.673104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.673311] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.673432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.673658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.673818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.673897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.674104] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.674346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.674428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.674579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.674659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.674748] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1771.743511] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1771.743698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1771.743750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1771.743950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1771.744113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1771.755545] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1773.077900] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1773.078242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.078320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.079496] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.079496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.079496] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1773.581618] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1773.581821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1773.581927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.582198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.582820] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1773.582942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1773.583011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.583201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.583293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.584025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.584025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1773.584025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1773.584025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.584264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.584264] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1773.584407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1773.584507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1773.584636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1773.584692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.584791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1773.584830] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1773.768678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1773.768905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.088277] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1774.105059] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.105254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.105330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.105643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.105762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.105993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.106119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.106176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.106341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.106423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.106619] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.106756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.106843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.106996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.108273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.108508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.108616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.108680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.108826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.108937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.108990] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1774.179914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.180084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.180158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.180364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.180510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.191626] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1774.478280] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1774.478394] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1776.204526] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1776.204883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.479689] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1779.480048] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1784.480787] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1784.481101] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1785.541709] env[71051]: INFO networking_nsxv3.common.synchronization [req-35ebd276-2ed9-4069-8f0a-baf24d451ccd req-25e2c9f7-916a-4152-99a5-15117baf341a tempest-ServerAddressesNegativeTestJSON-1084625052 tempest-ServerAddressesNegativeTestJSON-1084625052-project-member] Enqueued Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1785.542270] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1785.544061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.544206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.544281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.544549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.544716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.544830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.544878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.545051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.545140] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.545233] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.853925] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.854146] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-296" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.854284] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-296" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.854648] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-296" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.854992] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.855183] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.855310] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.855649] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.855692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.855895] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1785.856029] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1785.856149] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1785.856265] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1785.856383] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1785.856496] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1785.856940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1785.876020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1785.876200] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1785.876346] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1785.876563] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-296" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.876847] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.877051] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.877211] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.877468] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.877605] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce8765d0-4f3c-418c-bc8c-6725b1803d8b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.051698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.051868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.051945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.052141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.052236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.052436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.053028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.053028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.053028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.053028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.053028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69614980-875b-4e36-baa7-f93b8253813b already deleted. [ 1786.053028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.380367] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.380624] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.380758] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.381072] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.381242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.381407] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ce8765d0-4f3c-418c-bc8c-6725b1803d8b not found, creating... [ 1786.381684] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.381851] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.382688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.382688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.382688] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.382688] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.382991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.382991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.383116] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.383294] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.383424] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ce8765d0-4f3c-418c-bc8c-6725b1803d8b is going to be created. [ 1786.402124] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.402319] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.402441] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.402703] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.403120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.403226] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.139976] env[71051]: INFO networking_nsxv3.common.synchronization [req-35ebd276-2ed9-4069-8f0a-baf24d451ccd req-82431f55-8eec-4979-8cae-b70af56a3d6d service nova] Enqueued Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_rules [ 1787.140235] env[71051]: INFO networking_nsxv3.common.synchronization [req-35ebd276-2ed9-4069-8f0a-baf24d451ccd req-82431f55-8eec-4979-8cae-b70af56a3d6d service nova] Enqueued Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1787.140346] env[71051]: INFO networking_nsxv3.common.synchronization [req-35ebd276-2ed9-4069-8f0a-baf24d451ccd req-82431f55-8eec-4979-8cae-b70af56a3d6d service nova] Enqueued Resource ID: ce8765d0-4f3c-418c-bc8c-6725b1803d8b with Priority: HIGHEST for action port [ 1787.140859] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_rules [ 1787.141010] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1787.141119] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce8765d0-4f3c-418c-bc8c-6725b1803d8b with Priority: HIGHEST for action port [ 1787.141405] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.141538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.141605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.141857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.141941] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.143820] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.143820] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.143820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.143820] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.144479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.145847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.145847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.145847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.145847] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce8765d0-4f3c-418c-bc8c-6725b1803d8b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.647864] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.647864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.647864] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.649402] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce8765d0-4f3c-418c-bc8c-6725b1803d8b with status ACTIVE [ 1787.649590] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.651693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.651693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.651693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.651693] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce8765d0-4f3c-418c-bc8c-6725b1803d8b is going to be updated. [ 1787.669924] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.670067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.670120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.670296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.670426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.670579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce8765d0-4f3c-418c-bc8c-6725b1803d8b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.933073] env[71051]: INFO networking_nsxv3.common.synchronization [req-2cdceb7d-6d9f-4a79-8e9d-27dedac85669 req-9c50dd5a-4b9f-478b-b5fb-bd4911b2e494 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1787.933609] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1787.933912] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.938023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.938023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.938023] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1788.150238] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1788.305577] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.305864] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.306103] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.306360] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.306708] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.306887] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.310720] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.311069] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.311234] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.311512] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1788.311664] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1788.311776] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1788.311896] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1788.312026] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1788.312179] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1788.312371] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1788.330179] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1788.330861] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1788.330861] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1788.330861] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-15" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.330994] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-73f73d3e-8924-4155-bf75-be410df5806e taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.331358] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.331358] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.331650] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.331816] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f73d3e-8924-4155-bf75-be410df5806e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1788.439049] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.439049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.439049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.439049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.439330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.439330] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.439413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.439447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.440633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.440633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.440633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1788.464677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.464840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.464891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.465112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.465251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.472971] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1788.655908] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.656113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.656164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.656373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.656461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.656569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69614980-875b-4e36-baa7-f93b8253813b is going to be created. [ 1788.680379] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.680532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.680583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.682028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.682028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.689915] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: UNINITIALIZED for 2s [ 1788.834624] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.834903] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.835032] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.835319] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.835475] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.835641] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 73f73d3e-8924-4155-bf75-be410df5806e not found, creating... [ 1788.835910] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.836090] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.836210] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.836463] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.836577] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.836859] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.837031] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.837159] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.837376] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.837523] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.837670] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 73f73d3e-8924-4155-bf75-be410df5806e is going to be created. [ 1788.858654] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.858871] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.859012] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.859288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.859527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.859755] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.532471] env[71051]: INFO networking_nsxv3.common.synchronization [req-2cdceb7d-6d9f-4a79-8e9d-27dedac85669 req-46f69ea7-1e39-4533-a009-dc3bc4307e6e service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1789.532731] env[71051]: INFO networking_nsxv3.common.synchronization [req-2cdceb7d-6d9f-4a79-8e9d-27dedac85669 req-46f69ea7-1e39-4533-a009-dc3bc4307e6e service nova] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1789.532836] env[71051]: INFO networking_nsxv3.common.synchronization [req-2cdceb7d-6d9f-4a79-8e9d-27dedac85669 req-46f69ea7-1e39-4533-a009-dc3bc4307e6e service nova] Enqueued Resource ID: 73f73d3e-8924-4155-bf75-be410df5806e with Priority: HIGHEST for action port [ 1789.533154] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_rules [ 1789.533230] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1789.533294] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f73d3e-8924-4155-bf75-be410df5806e with Priority: HIGHEST for action port [ 1789.533904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.534042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.534163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.534309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.534391] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1789.535205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.535301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.535871] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f73d3e-8924-4155-bf75-be410df5806e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.535988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.536069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.536233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.536317] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f73d3e-8924-4155-bf75-be410df5806e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.038080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.038236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.040613] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f73d3e-8924-4155-bf75-be410df5806e with status ACTIVE [ 1790.040850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.040983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.041080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.041265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.041373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.041560] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.041666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.041729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.041882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.041963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.042159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.042253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.042318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.042458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.042535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.042619] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f73d3e-8924-4155-bf75-be410df5806e is going to be updated. [ 1790.061342] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.061467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.061514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.061676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.061798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.061946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f73d3e-8924-4155-bf75-be410df5806e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.482378] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1790.482378] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1790.482378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.482378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.482378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.482721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.482721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.482721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.482867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.482951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.483062] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.698455] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: SUCCESS [ 1790.698717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.698837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.699067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.699263] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.699402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.699850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.699850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.699850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.699850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.700093] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.985230] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.202675] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.202900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.202900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.203368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.203368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.203605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.203605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.203981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.204104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.204201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.204360] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.204473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.204538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.205018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.205018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.205018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.205018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.205245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.205245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.205317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.205395] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.487135] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.708806] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69614980-875b-4e36-baa7-f93b8253813b: rpc.has_security_group_logging(os_id): False [ 1791.725551] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.725777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.725777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.726011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.726112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.726900] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.726900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.726900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.726900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.726900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.727252] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.727252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.727252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.727368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.727491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.727599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.727799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.727799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.727960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.728390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.728462] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69614980-875b-4e36-baa7-f93b8253813b is going to be created. [ 1791.797877] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.798099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.798099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.798801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.798801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.821432] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: IN_PROGRESS for 2s [ 1791.991704] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.991704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.991704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.991704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.991704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.991704] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1792.032927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1792.033174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1792.033174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.033304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.033453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.044373] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1793.832478] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: SUCCESS [ 1793.832774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.057041] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1794.057195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.057354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.057586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.057785] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.058328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.058428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.058631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.058736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.058829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.058959] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.428500] env[71051]: INFO networking_nsxv3.common.synchronization [req-bbd0d4ea-1815-46e2-abc0-cad048700ff9 req-34d047c2-a7bb-4478-b767-6ceacf120ec3 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1794.429401] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1794.429401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.429594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.429594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.429774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.430773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.430773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.430773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.430773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.430773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.430773] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.561362] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.561555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.561625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.561838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.562014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.562485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.562560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.562727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.562817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.562911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.563080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.563176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.563234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.563382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.563548] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.563634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.563696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.564088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.564088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.564088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.564088] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.737709] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.737924] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.738070] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.738343] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.738616] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.738780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.739019] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.739129] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.739431] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.739551] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1794.739683] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1794.739799] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1794.739914] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1794.740045] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1794.740160] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1794.740302] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1794.759261] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1794.759849] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1794.759849] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1794.759849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.760035] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a5d3a310-dc46-4431-951a-5dbe47814ffe taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.760217] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.760864] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.761226] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.761379] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5d3a310-dc46-4431-951a-5dbe47814ffe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.935715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.935715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.935715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.935715] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1794.959513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.959513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.959513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.959513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.959513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.969485] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1795.070718] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49e506d-62f2-4518-a039-ac618500914a: rpc.has_security_group_logging(os_id): False [ 1795.086265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.086637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.086826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.087166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.087377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.087675] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.087903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.088073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.088346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.088531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.088834] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.089086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.089257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.089514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.089695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.089982] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.090220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.090368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.091047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.091047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.091047] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1795.151183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.151341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.151412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.151641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.151787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.162577] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1795.263982] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.264247] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.264364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.264707] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.264874] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.265049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a5d3a310-dc46-4431-951a-5dbe47814ffe not found, creating... [ 1795.265314] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.265482] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.265607] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.265868] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.266055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.266370] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.266540] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.266667] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.266886] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.267040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.267434] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a5d3a310-dc46-4431-951a-5dbe47814ffe is going to be created. [ 1795.305766] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.306013] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.306158] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.306425] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.306660] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.306892] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [req-bbd0d4ea-1815-46e2-abc0-cad048700ff9 req-f77920e1-2e20-4722-8f4f-d1acce8fee7f service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [req-bbd0d4ea-1815-46e2-abc0-cad048700ff9 req-f77920e1-2e20-4722-8f4f-d1acce8fee7f service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [req-bbd0d4ea-1815-46e2-abc0-cad048700ff9 req-f77920e1-2e20-4722-8f4f-d1acce8fee7f service nova] Enqueued Resource ID: a5d3a310-dc46-4431-951a-5dbe47814ffe with Priority: HIGHEST for action port [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1795.985359] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d3a310-dc46-4431-951a-5dbe47814ffe with Priority: HIGHEST for action port [ 1795.985359] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.985823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.985823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.985823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.985823] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1795.986594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.986697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.986884] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5d3a310-dc46-4431-951a-5dbe47814ffe taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.986983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.987053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.987459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.987459] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5d3a310-dc46-4431-951a-5dbe47814ffe',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1796.488953] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.488953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.496017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5d3a310-dc46-4431-951a-5dbe47814ffe with status ACTIVE [ 1796.496017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.496017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.496017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.496017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.496017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5d3a310-dc46-4431-951a-5dbe47814ffe is going to be updated. [ 1796.517555] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.517681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.517906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.518891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.518891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.518891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5d3a310-dc46-4431-951a-5dbe47814ffe" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.978868] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1796.979076] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 deletion is rescheduled due to dependency. [ 1796.979197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.979358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.979568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.979748] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.979865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.979930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.980099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.980183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.980277] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1797.175230] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1797.175611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1797.482802] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1797.985459] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1798.051959] env[71051]: INFO networking_nsxv3.common.synchronization [req-e2eb8c8f-709a-48ac-9198-ffebe315d5aa req-458dfb14-2661-4c7e-878c-0051faf47428 tempest-ServerAddressesNegativeTestJSON-1084625052 tempest-ServerAddressesNegativeTestJSON-1084625052-project-member] Enqueued Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1798.051959] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69614980-875b-4e36-baa7-f93b8253813b with Priority: HIGHEST for action security_group_members [ 1798.052155] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-69614980-875b-4e36-baa7-f93b8253813b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.052155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.052264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.052715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.052715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.052715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.052715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.052931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.052931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.052992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69614980-875b-4e36-baa7-f93b8253813b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1798.493481] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.493921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.493921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.494028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.494105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.494206] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1798.524996] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.525161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.525247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.525452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.525602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.533762] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1798.557377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.557511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.557566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.558608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.558608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.558608] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69614980-875b-4e36-baa7-f93b8253813b is going to be updated. [ 1798.587420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.587593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.587674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.587846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.587982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.598198] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: IN_PROGRESS for 2s [ 1798.838840] env[71051]: INFO networking_nsxv3.common.synchronization [req-0f72af1d-e177-4eeb-915f-cab8995ac175 req-08a9c8fa-ddcb-4aa0-8d96-ae52d5b57c58 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 1798.839376] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 1798.839719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.839851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.839851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.840115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.840272] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.840368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1798.840425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1798.840579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1798.840664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1798.840755] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.159986] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.160218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.160350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.160694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.160969] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.161148] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.161275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.161537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.161696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.161907] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1799.162049] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1799.162153] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1799.162263] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1799.162391] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1799.162491] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1799.162953] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1799.180574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1799.180758] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1799.180904] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1799.181087] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.181363] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-7a698812-d36d-4b07-9b9b-0dad873ec390 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.181556] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.181687] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.181966] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.182126] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a698812-d36d-4b07-9b9b-0dad873ec390',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.345774] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.345967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.346056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.346272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.346365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.346558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.346657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.346721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.346869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.346945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.347042] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 already deleted. [ 1799.347125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.684640] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.685046] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.685046] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.685331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.685489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.685699] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 7a698812-d36d-4b07-9b9b-0dad873ec390 not found, creating... [ 1799.685968] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.686141] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.686270] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.686503] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.686653] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.686971] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.687121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.687248] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.687478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.687612] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.687762] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 7a698812-d36d-4b07-9b9b-0dad873ec390 is going to be created. [ 1799.708075] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.708312] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.708451] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.708728] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.708972] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.709231] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [req-0f72af1d-e177-4eeb-915f-cab8995ac175 req-eee665cb-72bd-460e-af30-6c19313264ba service nova] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [req-0f72af1d-e177-4eeb-915f-cab8995ac175 req-eee665cb-72bd-460e-af30-6c19313264ba service nova] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [req-0f72af1d-e177-4eeb-915f-cab8995ac175 req-eee665cb-72bd-460e-af30-6c19313264ba service nova] Enqueued Resource ID: 7a698812-d36d-4b07-9b9b-0dad873ec390 with Priority: HIGHEST for action port [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 1800.515021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a698812-d36d-4b07-9b9b-0dad873ec390 with Priority: HIGHEST for action port [ 1800.515804] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.516176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.516387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.516845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.517083] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.518196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.518437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.519099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.519099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.519099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.519099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.519099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.519387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.519387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.519473] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.520901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a698812-d36d-4b07-9b9b-0dad873ec390 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.520901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.520901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.520901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.520901] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a698812-d36d-4b07-9b9b-0dad873ec390',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.543352] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1800.543596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.543999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.544216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.544403] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.544522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.544585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.544756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.544842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.544983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.545106] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.608016] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69614980-875b-4e36-baa7-f93b8253813b in Status: SUCCESS [ 1800.608217] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69614980-875b-4e36-baa7-f93b8253813b deletion is rescheduled due to dependency. [ 1800.608317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69614980-875b-4e36-baa7-f93b8253813b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.022609] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.022916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.022988] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.024274] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a698812-d36d-4b07-9b9b-0dad873ec390 with status ACTIVE [ 1801.024462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.024593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.024660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.024862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.025019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.025132] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.025228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.025289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.025439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.025518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.025694] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.025789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.025851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.025988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.026894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.026995] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a698812-d36d-4b07-9b9b-0dad873ec390 is going to be updated. [ 1801.048276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.048474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.048517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.048680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.048812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.048971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a698812-d36d-4b07-9b9b-0dad873ec390" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.049204] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.531426] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.552118] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 1801.570081] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.570330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.570412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.570713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.571250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.571599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.571883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.571883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.572156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.572304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.572457] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1801.632463] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.632664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1801.632711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1801.632931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1801.633103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1801.643797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1802.034036] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1802.034303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1802.034303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1802.034504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1802.034582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1802.034705] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be created. [ 1802.071769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1802.071769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1802.071769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1802.071987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1802.072183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1802.082372] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: UNINITIALIZED for 2s [ 1803.197188] env[71051]: INFO networking_nsxv3.common.synchronization [req-79a1dc24-3f54-4c7c-af00-897cd1307b43 req-e49f7c2d-f88b-42da-bfeb-dd14a67d5a05 tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1803.197188] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1803.197188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1803.197188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1803.197188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1803.198333] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1803.515826] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.516205] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1803.516347] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1803.516624] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1803.516894] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.517199] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1803.517352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1803.517632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1803.517885] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1803.518151] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1803.518328] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1803.518470] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1803.518605] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1803.518741] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1803.518886] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1803.518999] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1803.538484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1803.538729] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1803.538893] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1803.539084] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-499" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1803.539400] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.539579] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1803.539712] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1803.540037] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1803.540188] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1803.656147] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1803.656502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1803.700463] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1804.042427] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.043584] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.043757] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.044097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.044274] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.044440] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c not found, creating... [ 1804.044723] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.044914] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.045105] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.045300] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.045442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.045731] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.045894] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.046130] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.047107] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.047107] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.047107] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c is going to be created. [ 1804.071261] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.071261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.071261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.071261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.071261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.071261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.167096] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 1804.167337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.167507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.167723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.167915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.168046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.168125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.168267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.168350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.168437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.168532] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1804.202685] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1804.670809] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1804.705878] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.706142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.706142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.706356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.706458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.706564] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1804.734840] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.735068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.735068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.735318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.735473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.745480] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1805.115220] env[71051]: INFO networking_nsxv3.common.synchronization [req-79a1dc24-3f54-4c7c-af00-897cd1307b43 req-bcc73021-4e91-43fb-8ba8-822fb853a810 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1805.115420] env[71051]: INFO networking_nsxv3.common.synchronization [req-79a1dc24-3f54-4c7c-af00-897cd1307b43 req-bcc73021-4e91-43fb-8ba8-822fb853a810 service nova] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1805.115601] env[71051]: INFO networking_nsxv3.common.synchronization [req-79a1dc24-3f54-4c7c-af00-897cd1307b43 req-bcc73021-4e91-43fb-8ba8-822fb853a810 service nova] Enqueued Resource ID: 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c with Priority: HIGHEST for action port [ 1805.116195] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_rules [ 1805.116335] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1805.116436] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c with Priority: HIGHEST for action port [ 1805.116750] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.116873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.116944] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.117895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.117895] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1805.120663] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.120663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.120663] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.120663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.120663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.120663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.120663] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1805.175549] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b02920d4-bbc8-495c-8ae5-4c754953cd14: rpc.has_security_group_logging(os_id): False [ 1805.193563] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.193728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.193793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.194017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.194114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.194431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.194548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.194548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.194688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.194756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.194855] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be created. [ 1805.259546] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.259882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.259882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.262591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.262591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.272034] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 1805.625037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.625037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c with status ACTIVE [ 1805.625037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.625037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.625037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.625037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.625700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.625700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.625700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.625700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.625700] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c is going to be updated. [ 1805.652485] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.652485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.652485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.652485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.653304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.653647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99c42f66-f8e8-4f07-a3eb-fb4ffa18ad6c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.712755] env[71051]: INFO networking_nsxv3.common.synchronization [None req-63ee9f0c-83b0-402f-82b7-90ae94a788be None None] Enqueued Resource ID: 80882d2e-20e8-4438-8db2-ac1c81a5dbaf with Priority: HIGHEST for action port [ 1805.712755] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80882d2e-20e8-4438-8db2-ac1c81a5dbaf with Priority: HIGHEST for action port [ 1805.712755] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-80882d2e-20e8-4438-8db2-ac1c81a5dbaf taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.712755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80882d2e-20e8-4438-8db2-ac1c81a5dbaf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.712755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80882d2e-20e8-4438-8db2-ac1c81a5dbaf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.712755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80882d2e-20e8-4438-8db2-ac1c81a5dbaf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.712755] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80882d2e-20e8-4438-8db2-ac1c81a5dbaf',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1806.216218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80882d2e-20e8-4438-8db2-ac1c81a5dbaf [ 1806.216218] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1806.216218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1806.216218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.216218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.216618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.216618] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80882d2e-20e8-4438-8db2-ac1c81a5dbaf already deleted. [ 1806.216618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80882d2e-20e8-4438-8db2-ac1c81a5dbaf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.466980] env[71051]: INFO networking_nsxv3.common.synchronization [None req-bfa54588-4bbf-484e-acef-b1317e15c78d tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1806.468244] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1806.468592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1806.468773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1806.468879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.469168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.469303] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1806.550467] env[71051]: INFO networking_nsxv3.common.synchronization [None req-544224a9-5b84-4293-a848-f862f9ab2414 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1806.551340] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1806.551703] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1806.551812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1806.755100] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1806.755375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.755544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.755766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.755970] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1806.756134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1806.756198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.757141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.757141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.757141] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1806.990821] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1806.991492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1806.991642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.991905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.992072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.992405] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e already deleted. [ 1806.992550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1806.992747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1806.992952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1806.993080] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1807.259281] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1807.283779] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 1807.284042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1807.513935] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1807.514380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1807.514380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1807.514516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1807.514716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1807.514846] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e already deleted. [ 1807.514846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1807.761348] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1807.830542] env[71051]: INFO networking_nsxv3.common.synchronization [None req-387a3497-da76-41de-9626-c6af1eb03421 None None] Enqueued Resource ID: 14174e6f-1afc-43a8-afdb-6624986142d1 with Priority: HIGHEST for action port [ 1807.831298] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14174e6f-1afc-43a8-afdb-6624986142d1 with Priority: HIGHEST for action port [ 1807.834133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-14174e6f-1afc-43a8-afdb-6624986142d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1807.834133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14174e6f-1afc-43a8-afdb-6624986142d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1807.834133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14174e6f-1afc-43a8-afdb-6624986142d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1807.834133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14174e6f-1afc-43a8-afdb-6624986142d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1807.834133] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14174e6f-1afc-43a8-afdb-6624986142d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1808.265463] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1808.265638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1808.265675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1808.265924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1808.265999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1808.266087] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1808.302763] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1808.302763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1808.302763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1808.302763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1808.302763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1808.314456] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1808.334990] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14174e6f-1afc-43a8-afdb-6624986142d1 [ 1808.335587] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1808.335587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1808.335587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1808.335781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1808.339017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1808.339017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14174e6f-1afc-43a8-afdb-6624986142d1 already deleted. [ 1808.339017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14174e6f-1afc-43a8-afdb-6624986142d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.788437] env[71051]: INFO networking_nsxv3.common.synchronization [req-6ba9e6ae-7003-4127-8a22-f0c9b2dc9d31 req-f35c070d-cf9b-48be-88f8-7a915d50f2b7 tempest-ImagesTestJSON-984363383 tempest-ImagesTestJSON-984363383-project-member] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1809.788437] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGHEST for action security_group_members [ 1809.788437] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.788774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.788774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.788943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.790058] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.790058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.790058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.790058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.790058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.790058] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.291923] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.292181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.292181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.292427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.292541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.292749] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.292857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.292933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.293115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.293193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.293297] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be updated. [ 1810.318511] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.318511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.318511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.318511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.318511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.328167] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: IN_PROGRESS for 2s [ 1810.330101] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1810.330308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.330467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.330693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.330898] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.331024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.331090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.331255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.331338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.331432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.331522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.422598] env[71051]: INFO networking_nsxv3.common.synchronization [req-66be713f-2735-4597-9cb1-6dd1c90404fd req-9be00370-0e14-499c-bfe7-55520b8a8890 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1810.423231] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1810.423543] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.423712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.423795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.423976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.424903] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.424903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.424903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.424903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.424903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.425145] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.760844] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.761076] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.761211] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.761483] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.761806] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.761969] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.762127] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.762332] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.762482] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.762696] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1810.762815] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1810.762936] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1810.763728] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1810.763728] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1810.763728] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1810.763728] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1810.782498] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1810.782758] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1810.782951] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1810.783220] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.783673] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-694ea339-3ba5-4191-92cb-048c99a8e303 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.783987] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.784212] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.784638] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.784827] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('694ea339-3ba5-4191-92cb-048c99a8e303',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.834025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.835220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.835220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.836109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.836109] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.836109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.836109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.836109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.836385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.836385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.836385] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.836512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.836552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.836675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.836883] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.836883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.837041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.837227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.837275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.837355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.837422] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.926904] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1811.288395] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.288795] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.289106] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.289577] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.289858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.290196] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 694ea339-3ba5-4191-92cb-048c99a8e303 not found, creating... [ 1811.290557] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.290808] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.290900] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.291181] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.291358] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.291894] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.292095] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.292228] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.292470] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.292773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.292773] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 694ea339-3ba5-4191-92cb-048c99a8e303 is going to be created. [ 1811.314786] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.315047] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.315183] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.315456] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.315690] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.315917] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.342448] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88000fa0-ad41-4e33-a474-dbc4d09cd427: rpc.has_security_group_logging(os_id): False [ 1811.361102] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.361297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.361516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.361639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.361763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.362200] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.362200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.362200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.362434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.362482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.362708] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.362827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.362895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.363069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.363162] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.363387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.363494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.363561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.363959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.364084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.364185] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1811.429237] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1811.449593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.449752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.449801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.449993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.450174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.467864] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1811.932051] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.932051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.932051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.932051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.932500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.932500] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1811.963309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.963309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.963309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.963309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.963549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.973940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1812.007792] env[71051]: INFO networking_nsxv3.common.synchronization [req-66be713f-2735-4597-9cb1-6dd1c90404fd req-f7c10141-e974-4b01-99cc-f8bde15ce492 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1812.008017] env[71051]: INFO networking_nsxv3.common.synchronization [req-66be713f-2735-4597-9cb1-6dd1c90404fd req-f7c10141-e974-4b01-99cc-f8bde15ce492 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1812.008183] env[71051]: INFO networking_nsxv3.common.synchronization [req-66be713f-2735-4597-9cb1-6dd1c90404fd req-f7c10141-e974-4b01-99cc-f8bde15ce492 service nova] Enqueued Resource ID: 694ea339-3ba5-4191-92cb-048c99a8e303 with Priority: HIGHEST for action port [ 1812.008470] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1812.008615] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1812.008659] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694ea339-3ba5-4191-92cb-048c99a8e303 with Priority: HIGHEST for action port [ 1812.010431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.010564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.010635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.010844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.010928] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1812.011806] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.011905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.012116] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-694ea339-3ba5-4191-92cb-048c99a8e303 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.012224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.012288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.012639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.012639] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('694ea339-3ba5-4191-92cb-048c99a8e303',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1812.337149] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49e506d-62f2-4518-a039-ac618500914a in Status: SUCCESS [ 1812.337339] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49e506d-62f2-4518-a039-ac618500914a deletion is rescheduled due to dependency. [ 1812.337453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1812.514014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.514188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.515585] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 694ea339-3ba5-4191-92cb-048c99a8e303 with status ACTIVE [ 1812.515794] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.515958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.516084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.516282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.516408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1812.516592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.516695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.516757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.516907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.516978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1812.517167] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.517301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.517301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.517437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.517510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1812.517597] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 694ea339-3ba5-4191-92cb-048c99a8e303 is going to be updated. [ 1812.537244] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1812.537419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1812.537467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1812.537627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1812.537755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1812.537910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-694ea339-3ba5-4191-92cb-048c99a8e303" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1813.481872] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1813.482201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1813.984432] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1813.984432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1813.984432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1813.984651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1813.984885] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1813.985010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1813.985102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1813.985260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1813.985345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1813.985442] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1814.488539] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1814.994198] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1815.496856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.497219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.497219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.497525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.497525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.497525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1815.526860] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.527027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.527089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.527288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.527427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.535549] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1817.009411] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1817.009940] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1817.182310] env[71051]: INFO networking_nsxv3.common.synchronization [req-93ad9256-1aec-4fca-99ad-7371ead2f8f5 req-4e97aa14-2c10-40be-af49-02ce79d17a29 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1817.182964] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1817.183332] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.183460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.183533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.183842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.183917] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.183990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.184113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.184251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.184337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.184435] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1817.334027] env[71051]: INFO networking_nsxv3.common.synchronization [None req-d1ed6082-06b3-424c-b011-937460c0f072 None None] Enqueued Resource ID: 555f4389-acb9-44c0-847e-95c352cbbef9 with Priority: HIGHEST for action port [ 1817.334578] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555f4389-acb9-44c0-847e-95c352cbbef9 with Priority: HIGHEST for action port [ 1817.335541] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-555f4389-acb9-44c0-847e-95c352cbbef9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.335541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-555f4389-acb9-44c0-847e-95c352cbbef9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.335541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-555f4389-acb9-44c0-847e-95c352cbbef9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.335824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-555f4389-acb9-44c0-847e-95c352cbbef9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.335824] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('555f4389-acb9-44c0-847e-95c352cbbef9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1817.525778] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.526079] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.526200] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.526424] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.526691] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.526853] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.526973] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.527208] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.527360] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.527647] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1817.527737] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1817.527793] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1817.527896] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1817.528024] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1817.528141] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1817.528266] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1817.544086] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1817.544300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.544451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.544635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.544906] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.545047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.545047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.545193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.545293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.545365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.545454] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1817.550388] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1817.550493] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1817.550644] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1817.550817] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.551146] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-05f413bf-97b0-4744-b18a-5c2b5d5fc816 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.551336] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.551462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.551810] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.551967] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f413bf-97b0-4744-b18a-5c2b5d5fc816',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1817.561538] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1817.562202] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1817.687605] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.687893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.688014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.688259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.688374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.688584] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.688707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.688767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.688983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.688983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.689087] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1817.715034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.715217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.715217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.715622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.715622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.724819] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1817.838931] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 555f4389-acb9-44c0-847e-95c352cbbef9 [ 1817.838931] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.838931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.838931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.838931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.838931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.838931] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:555f4389-acb9-44c0-847e-95c352cbbef9 already deleted. [ 1817.838931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-555f4389-acb9-44c0-847e-95c352cbbef9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.049528] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.049831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.049831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.049981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.050171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.050274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.050337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.050580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.050580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.050669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.050788] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.050885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.050939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.051106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.051248] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.051338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.051393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.051536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.051642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.051736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.051821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1818.057686] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.057686] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.057848] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.058273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.058451] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.058652] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 05f413bf-97b0-4744-b18a-5c2b5d5fc816 not found, creating... [ 1818.058893] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.059140] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.059878] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.059878] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.059878] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.060099] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.060256] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.060411] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.060659] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.060839] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.061031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 05f413bf-97b0-4744-b18a-5c2b5d5fc816 is going to be created. [ 1818.104041] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.104041] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.104041] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.104284] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.104632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.108368] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.555813] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1818.574115] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.574284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.574354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.574633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.574633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.574855] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.574956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.575035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.575187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.575257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.575473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.575555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.575609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.575761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.575827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.576016] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.576112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.576172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.576306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.576381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.576467] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1818.637672] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.637862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.637908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.638155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.638321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1818.660048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1818.800095] env[71051]: INFO networking_nsxv3.common.synchronization [req-93ad9256-1aec-4fca-99ad-7371ead2f8f5 req-ff0655e3-8669-4146-bc6b-edb430ef26d9 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1818.800301] env[71051]: INFO networking_nsxv3.common.synchronization [req-93ad9256-1aec-4fca-99ad-7371ead2f8f5 req-ff0655e3-8669-4146-bc6b-edb430ef26d9 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1818.800448] env[71051]: INFO networking_nsxv3.common.synchronization [req-93ad9256-1aec-4fca-99ad-7371ead2f8f5 req-ff0655e3-8669-4146-bc6b-edb430ef26d9 service nova] Enqueued Resource ID: 05f413bf-97b0-4744-b18a-5c2b5d5fc816 with Priority: HIGHEST for action port [ 1818.800683] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1818.800811] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1818.800904] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f413bf-97b0-4744-b18a-5c2b5d5fc816 with Priority: HIGHEST for action port [ 1818.801456] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.801587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.801669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.801857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.801940] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1818.802750] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.802842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.803052] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f413bf-97b0-4744-b18a-5c2b5d5fc816 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1818.803144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1818.803240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1818.803372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1818.803442] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f413bf-97b0-4744-b18a-5c2b5d5fc816',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1819.305013] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.305577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.305577] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05f413bf-97b0-4744-b18a-5c2b5d5fc816 with status ACTIVE [ 1819.305721] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.305876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.305969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.306260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.306382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.306613] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.306741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.306807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.307032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.307121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.307350] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.307475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.307551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.307726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.307824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.307945] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05f413bf-97b0-4744-b18a-5c2b5d5fc816 is going to be updated. [ 1819.330387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.330387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.330387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.330387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.330387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.330617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f413bf-97b0-4744-b18a-5c2b5d5fc816" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.736876] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1819.736876] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.736876] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.736876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.736876] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1819.762590] env[71051]: INFO networking_nsxv3.common.synchronization [None req-de91a979-7abf-4877-8214-2909ca7062c8 None None] Enqueued Resource ID: 5a74de6c-8280-41f6-9f1d-34fee98adea4 with Priority: HIGHEST for action port [ 1819.763125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a74de6c-8280-41f6-9f1d-34fee98adea4 with Priority: HIGHEST for action port [ 1819.763427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a74de6c-8280-41f6-9f1d-34fee98adea4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.763549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a74de6c-8280-41f6-9f1d-34fee98adea4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.763617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a74de6c-8280-41f6-9f1d-34fee98adea4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.763910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a74de6c-8280-41f6-9f1d-34fee98adea4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.764136] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a74de6c-8280-41f6-9f1d-34fee98adea4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1820.239883] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1820.267992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a74de6c-8280-41f6-9f1d-34fee98adea4 [ 1820.267992] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1820.267992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1820.267992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1820.267992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1820.267992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1820.267992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a74de6c-8280-41f6-9f1d-34fee98adea4 already deleted. [ 1820.267992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a74de6c-8280-41f6-9f1d-34fee98adea4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1820.675559] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1820.675559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1820.743288] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1821.245061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1821.245686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1821.245812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1821.246082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1821.246180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1821.246419] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1821.277098] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1821.277098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1821.277098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1821.277098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1821.277098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1821.283627] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1823.295098] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1823.295464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.295510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.295709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.295902] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.296034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.296101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.296257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.296335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.296418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.296511] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1823.420556] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e91bc6a7-8653-49ca-956d-dd655469d755 None None] Enqueued Resource ID: 5785e794-1956-471b-a041-d33704bb2c3c with Priority: HIGHEST for action port [ 1823.420782] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5785e794-1956-471b-a041-d33704bb2c3c with Priority: HIGHEST for action port [ 1823.421946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5785e794-1956-471b-a041-d33704bb2c3c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.422117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5785e794-1956-471b-a041-d33704bb2c3c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.422186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5785e794-1956-471b-a041-d33704bb2c3c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.422448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5785e794-1956-471b-a041-d33704bb2c3c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.422534] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5785e794-1956-471b-a041-d33704bb2c3c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1823.799129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.799288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.799364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.799595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.799769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.799899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.799971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.800123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.800221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.800306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.800456] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.800550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.800604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.800851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.801017] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.801114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.801176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.801319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.801395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.801478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.801656] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1823.926854] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5785e794-1956-471b-a041-d33704bb2c3c [ 1823.926854] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1823.926854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1823.926854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1823.927082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1823.927082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1823.927237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5785e794-1956-471b-a041-d33704bb2c3c already deleted. [ 1823.928302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5785e794-1956-471b-a041-d33704bb2c3c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.304941] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1824.322655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1824.322959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1824.322959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.324031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1824.324031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.324533] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1824.324533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1824.324533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1824.324533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1824.324533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.324734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1824.324734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1824.324734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1824.324900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1824.324946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.325083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1824.384522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1824.384522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1824.384522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1824.384692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1824.384872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1824.398248] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1825.647078] env[71051]: INFO networking_nsxv3.common.synchronization [None req-7877a9d0-495b-4fa2-97eb-1defd47f8b36 None None] Enqueued Resource ID: 0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7 with Priority: HIGHEST for action port [ 1825.647078] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7 with Priority: HIGHEST for action port [ 1825.647612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.647977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.648592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.648592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.648592] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1825.812658] env[71051]: INFO networking_nsxv3.common.synchronization [req-34cbf898-cdf4-4d35-8eae-02c55ade2de9 req-5c734262-440a-46fc-9b4c-97dc41e5dae2 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 1825.814051] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 1825.814051] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.814051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.814051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.814051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.814315] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.814315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.814415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.814514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.814587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1825.814676] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1826.133731] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.133731] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.133937] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.135018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.135018] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.135018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.135018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.135018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.135300] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.135419] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1826.135725] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1826.135913] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1826.136233] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1826.136412] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1826.136550] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1826.136693] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1826.151854] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7 [ 1826.151908] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.152091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.152168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.152375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.152736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.152736] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7 already deleted. [ 1826.152736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e7a0ce2-ad2a-492d-8b47-c5aeb27427d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.156144] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1826.156373] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1826.156550] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1826.156806] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.157135] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-c720977d-f109-421a-b71a-d726ed1e5486 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.157347] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.157524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.157872] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.159307] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c720977d-f109-421a-b71a-d726ed1e5486',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1826.317014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.317308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.317425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.317610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.317723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.317925] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.318043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.318144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.318259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.318336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.318423] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e already deleted. [ 1826.318503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.409539] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1826.410068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.495241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.495241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.495241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.495241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.495241] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1826.664714] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.665231] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.665442] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.665842] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.666174] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.666424] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port c720977d-f109-421a-b71a-d726ed1e5486 not found, creating... [ 1826.667255] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.667529] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.668419] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.668941] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.669162] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.669530] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.669730] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.669910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.670317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.670317] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.670458] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: c720977d-f109-421a-b71a-d726ed1e5486 is going to be created. [ 1826.689870] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.690391] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1826.690391] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1826.690685] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1826.690936] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.691208] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.003026] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.428886] env[71051]: INFO networking_nsxv3.common.synchronization [req-34cbf898-cdf4-4d35-8eae-02c55ade2de9 req-27b74f49-5102-47b0-ac8d-531bed4c89dd service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1827.429173] env[71051]: INFO networking_nsxv3.common.synchronization [req-34cbf898-cdf4-4d35-8eae-02c55ade2de9 req-27b74f49-5102-47b0-ac8d-531bed4c89dd service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 1827.429378] env[71051]: INFO networking_nsxv3.common.synchronization [req-34cbf898-cdf4-4d35-8eae-02c55ade2de9 req-27b74f49-5102-47b0-ac8d-531bed4c89dd service nova] Enqueued Resource ID: c720977d-f109-421a-b71a-d726ed1e5486 with Priority: HIGHEST for action port [ 1827.429988] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 1827.430765] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 1827.430995] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c720977d-f109-421a-b71a-d726ed1e5486 with Priority: HIGHEST for action port [ 1827.432027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.432138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.432192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.432520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.432617] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.434244] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.434379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.434379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.436152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.436152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.436152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.436152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.436364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.436364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.436482] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.437450] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c720977d-f109-421a-b71a-d726ed1e5486 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.437600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.438188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.438188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.438188] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c720977d-f109-421a-b71a-d726ed1e5486',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.505428] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.940389] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.941907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.942039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.942205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c720977d-f109-421a-b71a-d726ed1e5486 with status ACTIVE [ 1827.942398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.942518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.942583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.944636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.944752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.945401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.946017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.946603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.946603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.946603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.946603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.946839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.946839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.946917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.946981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.947079] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c720977d-f109-421a-b71a-d726ed1e5486 is going to be updated. [ 1827.972018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.972210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1827.972286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1827.972434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1827.972566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1827.972722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c720977d-f109-421a-b71a-d726ed1e5486" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.008157] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1828.008314] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1828.449192] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.931064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.931230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.931306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.931521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.946286] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1828.946719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.948182] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1828.952075] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.952166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.952236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.952468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.952551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.952600] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be created. [ 1828.956348] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.957036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.957036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.957036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.957281] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.957348] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.957465] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.957679] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.957824] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.958047] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1828.958164] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1828.958279] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1828.958388] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1828.958500] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1828.958608] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1828.958743] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1828.980441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.980654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.980654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.980870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.991361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.992070] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1828.992158] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1828.992334] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1828.994198] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1828.994371] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1828.994558] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1828.994736] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1828.995112] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-29465047-4434-4c54-8fd3-55f66bfa7994 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.995306] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.996216] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.996585] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.996796] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29465047-4434-4c54-8fd3-55f66bfa7994',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.998603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.998603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1828.998754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1828.998847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1828.999028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.029715] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: UNINITIALIZED for 2s [ 1829.051146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.051291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.051806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.051806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.052999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.053211] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1829.139723] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.139898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.139985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.140181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.140475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.140754] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1829.231055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.231055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.231308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.231373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.231584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.231867] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1829.231963] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c1569210-7f11-407a-992e-cc729f87d941', '6c546a99-cc70-447b-86d7-8f2c7bf60dc8', 'd25bc2bf-35b9-46ff-8995-4834b28ed22a', '5fbed01f-5a92-4b01-a2c0-374a5bd0301a', '5a249b94-e86f-4544-bf26-60fa97eeaaed', 'a49e506d-62f2-4518-a039-ac618500914a', '806528ce-4973-42fd-b251-c3e1d4458d10', '59190f66-54f4-449e-a67c-42ef58b0914d', 'cc7a55e9-4711-4eed-99ed-cbe058c106cc', '6b6fa828-b174-4bb7-a914-8abc9f68e473', '29c8230f-81e9-43ef-8adc-85278751b6d7', 'd44d2b42-149f-48e5-8058-356410e335af', 'd0dc22fb-5e65-4d6f-8add-5ec49f4d0051', 'b02920d4-bbc8-495c-8ae5-4c754953cd14', 'a8620a6a-16cb-4fc6-af53-e0b0622d304d', '062ccdf8-4c1d-4d6e-b731-e0c7de49b27b', '8f5aee31-afbb-467a-9d2a-71123fe133d1', '59b1387f-82fc-4ceb-9ccc-ab09d9384c95', 'fb27aac1-26b8-4e44-9313-936316b62525', '3eb910ff-24da-4a21-bff7-7efb598948f2', '3d06bf6c-ef7f-42d0-911f-d260f48bffe2', '7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b', '3bba870c-b5d9-4661-a3d0-55e05367a8db', '5c611102-ef9e-4425-9ced-e6be888b77ae', 'df9ad0e2-035b-4633-b1f0-56f049ff846d', 'e2469f80-4eb1-4a87-9a72-0d981b145113', 'dd2b78d5-f56c-47e2-a26e-d87bff454fb0', 'abff08ff-fc06-4dbe-a011-a141e9aba9d4', '6235e93c-519f-43a7-8c8b-5c8b7d56575b', 'e4e569e0-1641-4c92-94b3-6745ffb49070', 'a48a7216-9768-452e-a3d9-cf477a05890c', '9efbdb84-0e00-421d-96e9-16064575b3b4', '88000fa0-ad41-4e33-a474-dbc4d09cd427', '69614980-875b-4e36-baa7-f93b8253813b', '61b3ef5c-fe30-4fa8-843f-b800b5921066', 'e9288720-d9f6-45b7-9a58-f770ce25595f', '1bbb30ff-0400-4ec6-ade0-aa4c2a91880b', '7f2493d4-27de-4333-a7cd-5237d967e052', '764cf243-3a8f-4abc-8bb0-1036c78cc82c'} {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1829.232067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1829.253146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.253297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.253416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.253583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.253666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.253830] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1829.253920] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1829.253964] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1829.331192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.331192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.331192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.331192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.332215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.332215] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1829.332215] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1829.332215] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1829.332215] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1829.332414] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1829.332414] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGH for action security_group_rules [ 1829.332414] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 1829.332530] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGH for action security_group_rules [ 1829.332530] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGH for action security_group_rules [ 1829.332596] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGH for action security_group_rules [ 1829.332690] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGH for action security_group_rules [ 1829.332690] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGH for action security_group_rules [ 1829.332788] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGH for action security_group_rules [ 1829.332788] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGH for action security_group_rules [ 1829.333134] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGH for action security_group_rules [ 1829.333134] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 1829.333134] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGH for action security_group_rules [ 1829.333134] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGH for action security_group_rules [ 1829.333379] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGH for action security_group_rules [ 1829.333379] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGH for action security_group_rules [ 1829.333379] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGH for action security_group_rules [ 1829.333379] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGH for action security_group_rules [ 1829.333573] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGH for action security_group_rules [ 1829.333573] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGH for action security_group_rules [ 1829.333573] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGH for action security_group_rules [ 1829.333696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.505047] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.505381] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.505908] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.505908] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.506316] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.506428] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.506752] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.506868] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.507136] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.507340] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.507736] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.507940] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.508164] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.508406] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.508589] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.508785] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 29465047-4434-4c54-8fd3-55f66bfa7994 is going to be updated. [ 1829.543639] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1829.543996] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1829.544124] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1829.544470] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1829.544713] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1829.545017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.351398] env[71051]: INFO networking_nsxv3.common.synchronization [req-e30e36b9-374b-47eb-80b2-a12d59c47e7b req-dd1ef77c-2447-49de-b411-52860d08a3b4 service nova] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1830.351398] env[71051]: INFO networking_nsxv3.common.synchronization [req-e30e36b9-374b-47eb-80b2-a12d59c47e7b req-dd1ef77c-2447-49de-b411-52860d08a3b4 service nova] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1830.351398] env[71051]: INFO networking_nsxv3.common.synchronization [req-e30e36b9-374b-47eb-80b2-a12d59c47e7b req-dd1ef77c-2447-49de-b411-52860d08a3b4 service nova] Enqueued Resource ID: 29465047-4434-4c54-8fd3-55f66bfa7994 with Priority: HIGHEST for action port [ 1830.351398] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_rules [ 1830.351925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1830.351925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29465047-4434-4c54-8fd3-55f66bfa7994 with Priority: HIGHEST for action port [ 1830.351925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGH for action security_group_rules [ 1830.351925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a with Priority: HIGH for action security_group_rules [ 1830.351925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGH for action security_group_rules [ 1830.352151] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d with Priority: HIGH for action security_group_rules [ 1830.352151] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 with Priority: HIGH for action security_group_rules [ 1830.352242] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27aac1-26b8-4e44-9313-936316b62525 with Priority: HIGH for action security_group_rules [ 1830.352327] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 with Priority: HIGH for action security_group_rules [ 1830.352363] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44d2b42-149f-48e5-8058-356410e335af with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 with Priority: HIGH for action security_group_rules [ 1830.353125] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGH for action security_group_rules [ 1830.353443] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49e506d-62f2-4518-a039-ac618500914a with Priority: HIGH for action security_group_rules [ 1830.353443] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGH for action security_group_rules [ 1830.353443] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed with Priority: HIGH for action security_group_rules [ 1830.353608] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 1830.353608] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGH for action security_group_rules [ 1830.354590] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.354720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.354782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.354984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.355086] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.355904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.357062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.357177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.357357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.357513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.357615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.357796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.357841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.359093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.359093] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.359093] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-29465047-4434-4c54-8fd3-55f66bfa7994 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.359093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.359093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.359093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.359093] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29465047-4434-4c54-8fd3-55f66bfa7994',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.359793] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.359860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.359917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.360117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.360167] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.360819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.360930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.360993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.363497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.366172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d25bc2bf-35b9-46ff-8995-4834b28ed22a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.366172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.366172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.366172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.366172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.366172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8620a6a-16cb-4fc6-af53-e0b0622d304d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.367233] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eb910ff-24da-4a21-bff7-7efb598948f2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.367336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.367400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.368145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.368145] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eb910ff-24da-4a21-bff7-7efb598948f2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.371093] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27aac1-26b8-4e44-9313-936316b62525 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.371258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.371348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.371480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.371557] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27aac1-26b8-4e44-9313-936316b62525',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.372275] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.372380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.372449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.372603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.372675] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b1387f-82fc-4ceb-9ccc-ab09d9384c95',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.375418] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5aee31-afbb-467a-9d2a-71123fe133d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.375487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.375525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.375683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.375748] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5aee31-afbb-467a-9d2a-71123fe133d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.377528] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.377654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.377722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.377880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.377950] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.379224] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.379342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.379394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.380138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.380138] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('062ccdf8-4c1d-4d6e-b731-e0c7de49b27b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.380452] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.380452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.380452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.380688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.380770] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0dc22fb-5e65-4d6f-8add-5ec49f4d0051',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.381443] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44d2b42-149f-48e5-8058-356410e335af taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.381547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.381618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.381781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.381873] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44d2b42-149f-48e5-8058-356410e335af',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.382665] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.382776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.382864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.383072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.383154] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.383928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b6fa828-b174-4bb7-a914-8abc9f68e473 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.384138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.384220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.384357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.384430] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b6fa828-b174-4bb7-a914-8abc9f68e473',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.385311] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.385445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.385497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.385947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.385947] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.386559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49e506d-62f2-4518-a039-ac618500914a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.386559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.386682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.387098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.387098] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49e506d-62f2-4518-a039-ac618500914a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.387770] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.387770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.388489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.388489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.388489] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.388727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a249b94-e86f-4544-bf26-60fa97eeaaed taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.388802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.388863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.389021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.389097] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a249b94-e86f-4544-bf26-60fa97eeaaed',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.389757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.389860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.389918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.390096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.390178] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.391543] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.391659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.391789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.391957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.392046] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.898755] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.898955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.903158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.903425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.903639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.903825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.903906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.904108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.904205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.904320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.904451] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.905521] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.905593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.905649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.905836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.906149] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.906320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.906392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.906570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.906995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.906995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.906995] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.907643] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29465047-4434-4c54-8fd3-55f66bfa7994 with status ACTIVE [ 1830.907815] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.907920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.907987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.908179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.908267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.908464] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.908583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.908653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.908824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.908908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.909137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.909234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.909290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.909434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.909548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.909621] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29465047-4434-4c54-8fd3-55f66bfa7994 is going to be updated. [ 1830.914070] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.914989] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.915123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.915192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.915354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.915539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.915644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.915735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.915902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.915993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.916082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.916198] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.921540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.921540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.921540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.921540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.921540] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.923873] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.923992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.924194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.924457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.924547] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.924627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.924745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.924937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.925027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.925138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.925522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.934364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.934500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.934500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.934659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.935055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.935137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.935191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.935346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.935432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.935535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.935698] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.936672] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.936735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.936882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.937017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.937167] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.937404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.937404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.937511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.937550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.937633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.937913] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.971049] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.972118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.972118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.972118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.976237] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.976237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.977342] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.977440] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.985257] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.985369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.986200] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.986317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.987062] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.987172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.987878] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.987999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.988927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.989088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.989850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.990028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.990081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1830.990289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1830.990412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.990541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29465047-4434-4c54-8fd3-55f66bfa7994" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.992690] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.992827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.993549] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.993675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.994348] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1830.994772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.994899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.995479] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1830.995927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.996024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1830.996749] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1830.997088] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.997304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.002435] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1831.002928] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.003082] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27aac1-26b8-4e44-9313-936316b62525 is going to be deleted. [ 1831.004057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.004287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.020507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.020507] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d25bc2bf-35b9-46ff-8995-4834b28ed22a is going to be deleted. [ 1831.021741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.021741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.036268] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 1831.036537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.036653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.036836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.037031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.037153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.037220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.037368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.037449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.037534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.037623] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.054897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.055053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8620a6a-16cb-4fc6-af53-e0b0622d304d is going to be deleted. [ 1831.055907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.056161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.064688] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.064846] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.085024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.085024] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0dc22fb-5e65-4d6f-8add-5ec49f4d0051 is going to be deleted. [ 1831.085024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.085024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.092540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.092666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.116100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.116100] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be deleted. [ 1831.116100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.116100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.116100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.116100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.161781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.161955] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eb910ff-24da-4a21-bff7-7efb598948f2 is going to be deleted. [ 1831.162872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.163096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.200159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.200353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.213456] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.213622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.217741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.217896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44d2b42-149f-48e5-8058-356410e335af is going to be deleted. [ 1831.218791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.219045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.298405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.298569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b1387f-82fc-4ceb-9ccc-ab09d9384c95 is going to be deleted. [ 1831.299454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.299666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.301043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.301170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.399293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.399293] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a249b94-e86f-4544-bf26-60fa97eeaaed is going to be deleted. [ 1831.399293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.399293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.420607] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.422870] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.422870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.422870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.422870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.422870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.422870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.423492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.423492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.423492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.423492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.423492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.423492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.423867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.423867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.423867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.424106] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.424106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.427145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.427145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.427145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.427145] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.427145] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.428871] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.428967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.439857] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.440659] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.441515] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.445993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.446221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.446221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.446418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.446579] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.446681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.446746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.446916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.446977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.447079] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.447327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.447327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.447456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.447494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.447735] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.447786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.447856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.448011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.448091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.448175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.448258] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.448992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.456584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.456709] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 062ccdf8-4c1d-4d6e-b731-e0c7de49b27b is going to be deleted. [ 1831.457665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.457800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.469569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.469569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.482923] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.483086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.487380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.487508] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49e506d-62f2-4518-a039-ac618500914a is going to be deleted. [ 1831.488381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.488748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.540755] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1831.559411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.559411] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5aee31-afbb-467a-9d2a-71123fe133d1 is going to be deleted. [ 1831.561288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.562015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.597048] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b6fa828-b174-4bb7-a914-8abc9f68e473 is going to be deleted. [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27aac1-26b8-4e44-9313-936316b62525" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.597048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.598279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.598508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d25bc2bf-35b9-46ff-8995-4834b28ed22a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.599390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.599670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.599849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.600080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8620a6a-16cb-4fc6-af53-e0b0622d304d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.600320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0dc22fb-5e65-4d6f-8add-5ec49f4d0051" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.601854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eb910ff-24da-4a21-bff7-7efb598948f2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.602644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.602897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.603084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.603306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44d2b42-149f-48e5-8058-356410e335af" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.603534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.603925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b1387f-82fc-4ceb-9ccc-ab09d9384c95" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.604716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a249b94-e86f-4544-bf26-60fa97eeaaed" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.647676] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.648082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.648385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.648968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.649175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.649329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-062ccdf8-4c1d-4d6e-b731-e0c7de49b27b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.650381] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.651104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.651252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.651518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.651690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.652273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49e506d-62f2-4518-a039-ac618500914a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.722313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.722882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.723023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.723273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.723396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.723568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5aee31-afbb-467a-9d2a-71123fe133d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.778810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.778810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.778810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.778810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.778810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.778810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b6fa828-b174-4bb7-a914-8abc9f68e473" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.933025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1569210-7f11-407a-992e-cc729f87d941: rpc.has_security_group_logging(os_id): False [ 1831.933025] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.933025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.933025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.933025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.933025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1831.933025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 is going to be updated. [ 1831.934391] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1831.946022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 806528ce-4973-42fd-b251-c3e1d4458d10: rpc.has_security_group_logging(os_id): False [ 1831.946022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b02920d4-bbc8-495c-8ae5-4c754953cd14: rpc.has_security_group_logging(os_id): False [ 1831.946022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fbed01f-5a92-4b01-a2c0-374a5bd0301a: rpc.has_security_group_logging(os_id): False [ 1831.951379] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c546a99-cc70-447b-86d7-8f2c7bf60dc8: rpc.has_security_group_logging(os_id): False [ 1831.953376] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.953881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.954053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1831.955049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1831.957309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 1831.977357] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.977357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.987339] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.987339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.988349] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.988543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.990335] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.990690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.991654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.992383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1831.998331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1831.998443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.003668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.004850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.005235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.005235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.005414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.005525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.005688] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.005791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.005850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.006016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.006092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.006269] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.006349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.006401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.006935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.007091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.007213] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1832.008555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.008755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.010630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.011128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.011317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.011531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.011881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.036770] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: IN_PROGRESS for 2s [ 1832.043241] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2340689e-da3e-4aee-87d6-1ef7d8ca959e: rpc.has_security_group_logging(os_id): False [ 1832.064727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.064727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.065583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.065672] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.065902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.065902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.066128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.066308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.066439] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1569210-7f11-407a-992e-cc729f87d941 is going to be updated. [ 1832.068130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.068130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.114845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.115066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.115203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.115265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.115477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.115559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.115756] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.115864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.115922] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.116095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.116165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.116339] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.116417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.116471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.116610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.116685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.116781] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1832.118579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.118889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.120669] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.120793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.175143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.175635] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.175635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.175822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.175996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.176226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.176385] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1832.181075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.181367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.186939] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.186939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.188755] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8a7acad5-3cbb-4f56-a630-bef1f2e68b74 None None] Enqueued Resource ID: 508653e7-33d5-4292-8d1f-f01a24a46a2c with Priority: HIGHEST for action port [ 1832.190080] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 508653e7-33d5-4292-8d1f-f01a24a46a2c with Priority: HIGHEST for action port [ 1832.190080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-508653e7-33d5-4292-8d1f-f01a24a46a2c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.190080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-508653e7-33d5-4292-8d1f-f01a24a46a2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.190080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-508653e7-33d5-4292-8d1f-f01a24a46a2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.190402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-508653e7-33d5-4292-8d1f-f01a24a46a2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.190467] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('508653e7-33d5-4292-8d1f-f01a24a46a2c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1832.234587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.234907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.235416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.235416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.235553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.235592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.235669] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 is going to be updated. [ 1832.237953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.238222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.278176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.278325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.289053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.289053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.289053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.289053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.289053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.289053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.289053] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 1832.289629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.289629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.289688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.290696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.290924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.291068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.294054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.294054] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be created. [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.294054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.294374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.295248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.295421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.360751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.360907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.365728] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.365868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.371839] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: IN_PROGRESS for 2s [ 1832.372113] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1832.376045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.376522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.376688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.376808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.377131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.377273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.377436] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a is going to be updated. [ 1832.379310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.379591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.379796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.381433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.381636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.381860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.382924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.383329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.383491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.457513] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1832.458324] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: IN_PROGRESS for 2s [ 1832.462199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.462338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.462411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.462630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.462809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.467892] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.468032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.468091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.468509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.468657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.477324] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1832.489515] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 1832.491090] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 1832.519484] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.519649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.519723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.519976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.520160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.554028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: IN_PROGRESS for 2s [ 1832.692581] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 508653e7-33d5-4292-8d1f-f01a24a46a2c [ 1832.692825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1832.693033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1832.693033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1832.693260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1832.693352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1832.693450] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:508653e7-33d5-4292-8d1f-f01a24a46a2c already deleted. [ 1832.693532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-508653e7-33d5-4292-8d1f-f01a24a46a2c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.062020] env[71051]: INFO networking_nsxv3.common.synchronization [req-1cfff983-30cb-4329-8179-bd2298d9ac77 req-fde053b9-118b-47a9-8e82-0a83f48a8fda tempest-ServerMetadataTestJSON-1595872334 tempest-ServerMetadataTestJSON-1595872334-project-member] Enqueued Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1833.062189] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1833.062554] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.062702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.062780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.063069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.063261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.064030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.064030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.064030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.064030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.064030] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1833.569744] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.570132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.570132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.570227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.570324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.570550] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.570707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.570775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.570933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.571015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.571111] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 already deleted. [ 1833.571191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.573022] env[71051]: INFO networking_nsxv3.common.synchronization [req-013e01b6-ebb2-4023-8f80-8e36ff5b3d61 req-1edbf0a9-7f5a-4d09-a81b-1396de345ddc tempest-AttachVolumeTestJSON-2026923566 tempest-AttachVolumeTestJSON-2026923566-project-member] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1833.573022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGHEST for action security_group_members [ 1833.573022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.573178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.573207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.573350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.574038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.574038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.574038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.575056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.575056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.575056] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1833.626981] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.626981] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-354" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.626981] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-354" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.626981] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-354" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.627479] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.627864] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.628149] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.628507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.629291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.629660] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1833.629935] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1833.631810] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1833.634226] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1833.634377] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1833.634607] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1833.634840] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1833.664122] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1833.664122] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1833.664304] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1833.664516] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-354" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.665178] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-c78983c6-f3ee-464e-b918-c74038227055 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.665178] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.665288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.665914] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.665914] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78983c6-f3ee-464e-b918-c74038227055',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1833.894463] env[71051]: INFO networking_nsxv3.common.synchronization [req-d7f892e6-3b6c-47f5-baeb-0bee20291b35 req-b6ac7026-d848-4dc4-9119-9b706f154d01 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1833.895376] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1833.895416] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.895529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.895602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.895799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.896328] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1833.901146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1833.901258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1833.901473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1833.901561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1833.901663] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1834.053057] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: SUCCESS [ 1834.053293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.053480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.053701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.053971] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.054110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.054178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.054344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.054426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.054513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.054609] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1834.077677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.077839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.077911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.078160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.078253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.078527] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.080554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.080554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.080554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.080688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.080740] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 is going to be updated. [ 1834.110315] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.110315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.110315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.110315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.110315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.118857] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: IN_PROGRESS for 2s [ 1834.177020] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.177020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port c78983c6-f3ee-464e-b918-c74038227055 not found, creating... [ 1834.177020] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.177020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.178421] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.179066] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.179373] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.179757] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.181967] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.181967] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: c78983c6-f3ee-464e-b918-c74038227055 is going to be created. [ 1834.214481] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.214481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.214481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.214481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.214481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.214481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.386471] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: SUCCESS [ 1834.386787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.387800] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1834.388191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.404687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.405152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.405269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.405569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.431598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.431897] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.432075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.432177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.432474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.432877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.432877] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1834.464894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.465268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.468025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.468025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.468025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.472469] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1834.476473] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1834.476844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.477566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: SUCCESS [ 1834.477761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.486123] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1834.486337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.500681] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 1834.500946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.502687] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 1834.503188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.557332] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1834.576526] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: SUCCESS [ 1834.576908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.937669] env[71051]: INFO networking_nsxv3.common.synchronization [req-1cfff983-30cb-4329-8179-bd2298d9ac77 req-eb318488-c67e-476b-a849-701d555c31a3 service nova] Enqueued Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_rules [ 1834.937669] env[71051]: INFO networking_nsxv3.common.synchronization [req-1cfff983-30cb-4329-8179-bd2298d9ac77 req-eb318488-c67e-476b-a849-701d555c31a3 service nova] Enqueued Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1834.937768] env[71051]: INFO networking_nsxv3.common.synchronization [req-1cfff983-30cb-4329-8179-bd2298d9ac77 req-eb318488-c67e-476b-a849-701d555c31a3 service nova] Enqueued Resource ID: c78983c6-f3ee-464e-b918-c74038227055 with Priority: HIGHEST for action port [ 1834.941514] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_rules [ 1834.941759] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1834.941759] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78983c6-f3ee-464e-b918-c74038227055 with Priority: HIGHEST for action port [ 1834.942072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.942214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.942278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.942916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.943218] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1834.944170] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.944332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.944379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.944549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.944710] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.944808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.945119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.945119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.945119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1834.945239] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1834.945998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c78983c6-f3ee-464e-b918-c74038227055 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1834.946535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1834.946616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1834.946791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1834.946853] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78983c6-f3ee-464e-b918-c74038227055',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1835.058116] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a858584b-3f6e-40f2-8270-905618594317 None None] Enqueued Resource ID: 7fe99fb0-a481-4921-8313-09ac099d74d1 with Priority: HIGHEST for action port [ 1835.058462] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe99fb0-a481-4921-8313-09ac099d74d1 with Priority: HIGHEST for action port [ 1835.058978] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fe99fb0-a481-4921-8313-09ac099d74d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.059136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fe99fb0-a481-4921-8313-09ac099d74d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.059206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fe99fb0-a481-4921-8313-09ac099d74d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.059450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fe99fb0-a481-4921-8313-09ac099d74d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.059595] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fe99fb0-a481-4921-8313-09ac099d74d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1835.065263] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd2b78d5-f56c-47e2-a26e-d87bff454fb0: rpc.has_security_group_logging(os_id): False [ 1835.082459] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.082563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.082655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.082906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.102310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.105031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.105031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.105031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.105031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.105031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.105031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 is going to be updated. [ 1835.163966] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.164243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.164377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.164609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.164828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.176933] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: IN_PROGRESS for 2s [ 1835.450136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.450136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.450136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c78983c6-f3ee-464e-b918-c74038227055 with status ACTIVE [ 1835.450136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.450136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.450136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.450136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.450136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.450136] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.450605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.450605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.450605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.451103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.451248] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.451349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.451420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.451607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.451713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.451872] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c78983c6-f3ee-464e-b918-c74038227055 is going to be updated. [ 1835.453103] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1835.474034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.474170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.474266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.474436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.474568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.474726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c78983c6-f3ee-464e-b918-c74038227055" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.565695] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fe99fb0-a481-4921-8313-09ac099d74d1 [ 1835.565963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1835.566144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1835.566233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1835.566472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1835.566582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.566724] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fe99fb0-a481-4921-8313-09ac099d74d1 already deleted. [ 1835.566791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fe99fb0-a481-4921-8313-09ac099d74d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1835.955341] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1836.129291] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806528ce-4973-42fd-b251-c3e1d4458d10 in Status: SUCCESS [ 1836.129291] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 deletion is rescheduled due to dependency. [ 1836.129453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1836.459122] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1836.459578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1836.459854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1836.460198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1836.460387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1836.460603] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 is going to be created. [ 1836.483732] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1836.483732] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1836.483732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1836.500171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1836.500340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1836.500407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1836.500629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1836.500822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1836.516917] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: UNINITIALIZED for 2s [ 1837.042924] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c4d9f3e-562d-4965-8bd2-139fdacb71d6 req-5e3a1a9d-bcdb-4ea1-aa73-6e66e72c462c tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1837.043583] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1837.045042] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.045042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.045042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.045042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.045247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.045314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.045436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.045589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.045653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1837.045743] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1837.192106] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: SUCCESS [ 1837.192334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1837.549634] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.549844] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.550015] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.550315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.550610] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.550810] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.550951] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.552385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.552594] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1837.552828] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1837.552954] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1837.553089] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1837.553201] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1837.553340] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1837.553487] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1837.553596] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1837.555378] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1837.575640] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1837.575640] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1837.575640] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1837.575640] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1837.575640] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.576055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.576055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.576648] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.576648] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4dfac6-ffd3-48c8-b344-a4a13e239e72',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.058926] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.079187] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.079538] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.079745] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.080920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.080920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.080920] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ac4dfac6-ffd3-48c8-b344-a4a13e239e72 not found, creating... [ 1838.080920] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.081229] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.081445] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.081719] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.082828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.082828] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.083193] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.083388] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.083660] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.083880] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.084077] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ac4dfac6-ffd3-48c8-b344-a4a13e239e72 is going to be created. [ 1838.111452] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.111716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.111827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.112261] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.112646] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.112870] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.526430] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: SUCCESS [ 1838.526704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.526879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.527152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.527369] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.527503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.527571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.527748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.527843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.527953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.528062] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.563337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.563337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.563337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.563337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.563337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.563337] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1838.590123] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.590123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.590123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.590123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.590123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1838.601559] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1838.981575] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c4d9f3e-562d-4965-8bd2-139fdacb71d6 req-02d258c9-9815-44fa-af17-5c62f5598182 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1838.981812] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c4d9f3e-562d-4965-8bd2-139fdacb71d6 req-02d258c9-9815-44fa-af17-5c62f5598182 service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1838.981951] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c4d9f3e-562d-4965-8bd2-139fdacb71d6 req-02d258c9-9815-44fa-af17-5c62f5598182 service nova] Enqueued Resource ID: ac4dfac6-ffd3-48c8-b344-a4a13e239e72 with Priority: HIGHEST for action port [ 1838.982211] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1838.982345] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1838.982434] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4dfac6-ffd3-48c8-b344-a4a13e239e72 with Priority: HIGHEST for action port [ 1838.983013] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.983697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.983766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.984010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.984101] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.985656] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.985869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.986111] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1838.986226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1838.986280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1838.986464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1838.986546] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4dfac6-ffd3-48c8-b344-a4a13e239e72',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1839.032220] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.032220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.032220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.032220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.032220] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.032220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.032220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.032478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.032478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.032530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.032673] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.032801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.032878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.033042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.033187] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.033295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.033382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.033538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.033622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.033705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.033827] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1839.487014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.487299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.490137] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac4dfac6-ffd3-48c8-b344-a4a13e239e72 with status ACTIVE [ 1839.490137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.490137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.490137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.490392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.490392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.490585] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.490650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.490732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.490895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.490950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.491180] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.491280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.491280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.491414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.491520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.491654] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac4dfac6-ffd3-48c8-b344-a4a13e239e72 is going to be updated. [ 1839.513909] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.514081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.514200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.514349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.514490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.514653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac4dfac6-ffd3-48c8-b344-a4a13e239e72" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.536376] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 459311b7-7a4a-42e2-a893-f7e671e0dc28: rpc.has_security_group_logging(os_id): False [ 1839.554433] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.555347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.555347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.555616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.555616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.555744] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.555841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.555903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.556058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.556136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.556347] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.556449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.556513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.556655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.556731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.556818] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 is going to be created. [ 1839.616449] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1839.616449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1839.616449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1839.616449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1839.616631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1839.628683] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: IN_PROGRESS for 2s [ 1840.042080] env[71051]: INFO networking_nsxv3.common.synchronization [req-aeacc54e-d066-433a-9e47-ba0ea78c136c req-827c7fbc-781b-4d26-91a6-5ba68f7738ac tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1840.043141] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1840.043577] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.043717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.043923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.044214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.044418] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.044532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.044627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.044844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.044986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.045120] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1840.051926] env[71051]: INFO networking_nsxv3.common.synchronization [None req-8f72adbc-6d5a-43f1-9d5b-e4cc3e80e2af tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: 65c24ece-7329-4a42-a523-22db19d09c09 with Priority: HIGHEST for action security_group_rules [ 1840.052426] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c24ece-7329-4a42-a523-22db19d09c09 with Priority: HIGHEST for action security_group_rules [ 1840.053063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c24ece-7329-4a42-a523-22db19d09c09 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.053228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.053319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.053602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.053990] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c24ece-7329-4a42-a523-22db19d09c09',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1840.212027] env[71051]: INFO networking_nsxv3.common.synchronization [None req-365a2495-031f-4c35-a2d6-40f942c9367c tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: 65c24ece-7329-4a42-a523-22db19d09c09 with Priority: HIGHEST for action security_group_rules [ 1840.212027] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c24ece-7329-4a42-a523-22db19d09c09 with Priority: HIGHEST for action security_group_rules [ 1840.212027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c24ece-7329-4a42-a523-22db19d09c09 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.212027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.550836] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1840.574819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.575041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.575111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.575338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.575430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.575531] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c24ece-7329-4a42-a523-22db19d09c09 already deleted. [ 1840.575614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.575802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.576077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.576203] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c24ece-7329-4a42-a523-22db19d09c09',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1840.614332] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.614332] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.614332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.614332] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.052640] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.100273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.100273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.100273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.101169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.101169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.101169] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c24ece-7329-4a42-a523-22db19d09c09 already deleted. [ 1841.101169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c24ece-7329-4a42-a523-22db19d09c09" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.116673] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.554559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.554953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.554953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.555175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.555274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.555375] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1841.584957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.585186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.585284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.585780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.585945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.596484] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1841.618071] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.640139] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: SUCCESS [ 1841.640373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.776387] env[71051]: INFO networking_nsxv3.common.synchronization [req-7b039f67-6094-4b31-b6b2-ae55ce5d43d5 req-740e1d60-f6ff-435d-b383-77ac6abb53b2 tempest-ServerRescueTestJSON-877836862 tempest-ServerRescueTestJSON-877836862-project-member] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1841.777012] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1841.777374] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.777529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.777602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.777897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.778240] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.778401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.778464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.778636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.778732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.779041] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1842.112907] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.113169] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.113307] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.113661] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.114039] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.114225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.114353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.114593] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.114768] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.115102] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1842.115243] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1842.115360] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1842.115476] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1842.115592] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1842.115720] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1842.115992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1842.120566] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.120694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.120766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.121059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.121141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.121263] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1842.137741] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1842.137947] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1842.138111] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1842.138526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.138946] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-b26a7da6-c894-472f-bb20-c4aec6d05284 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.139179] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.139334] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.139689] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.139863] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b26a7da6-c894-472f-bb20-c4aec6d05284',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1842.158901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.159102] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.159159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.159369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.159537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.168865] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1842.281835] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.281835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.281835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.281835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.281835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.282107] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.282157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.282188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.282750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.282750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.282750] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 already deleted. [ 1842.282750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.642356] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.642664] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.643187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.643187] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.643376] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.643886] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port b26a7da6-c894-472f-bb20-c4aec6d05284 not found, creating... [ 1842.644225] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.644410] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.644541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.644927] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.644987] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.645314] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.645487] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.645638] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.645875] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.646036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.646191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: b26a7da6-c894-472f-bb20-c4aec6d05284 is going to be created. [ 1842.684614] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.684940] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.685155] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.685481] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.685713] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.685985] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [req-7b039f67-6094-4b31-b6b2-ae55ce5d43d5 req-9008509a-aeb7-4ce8-a9e5-a1c956df4e17 service nova] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_rules [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [req-7b039f67-6094-4b31-b6b2-ae55ce5d43d5 req-9008509a-aeb7-4ce8-a9e5-a1c956df4e17 service nova] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [req-7b039f67-6094-4b31-b6b2-ae55ce5d43d5 req-9008509a-aeb7-4ce8-a9e5-a1c956df4e17 service nova] Enqueued Resource ID: b26a7da6-c894-472f-bb20-c4aec6d05284 with Priority: HIGHEST for action port [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_rules [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1843.367719] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26a7da6-c894-472f-bb20-c4aec6d05284 with Priority: HIGHEST for action port [ 1843.367719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.367719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.367719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.367719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.367719] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1843.368399] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.368399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.368399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.368399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.368612] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.368669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.368703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.368861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.368954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.369066] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1843.369918] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b26a7da6-c894-472f-bb20-c4aec6d05284 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.370038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.370129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.370258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.370326] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b26a7da6-c894-472f-bb20-c4aec6d05284',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1843.606668] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1843.606895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.876038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.876038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.876038] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1843.877089] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b26a7da6-c894-472f-bb20-c4aec6d05284 with status ACTIVE [ 1843.880409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.880409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.880409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.880409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.880829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.880829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.880875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.881029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b26a7da6-c894-472f-bb20-c4aec6d05284 is going to be updated. [ 1843.902085] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.902310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.902410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.902713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.903288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.903288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b26a7da6-c894-472f-bb20-c4aec6d05284" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.088253] env[71051]: INFO networking_nsxv3.common.synchronization [req-5bb3c134-bceb-4a35-8754-1b83732bbc2b req-780d3f40-58c3-47aa-8811-1324130361f2 tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1844.089197] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGHEST for action security_group_members [ 1844.089197] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.089411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.089411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.089514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.089622] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.089712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.089788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.090203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.090203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.092683] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1844.181705] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1844.181941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.182124] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.182334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.182535] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.182685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.182898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.182898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.183032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.183082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.183182] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1844.331020] env[71051]: INFO networking_nsxv3.common.synchronization [req-be5781d8-678c-4731-b3de-7dc79045aa04 req-2871eeb7-3815-4dc1-9a0d-4538d7b835bb tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1844.331020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1844.331508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.331765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.331996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.332325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.332569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.332838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.332991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.333228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.333398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.333557] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1844.383572] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1844.595932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.595932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.595932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.595932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.595932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.596203] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.596203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.596362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.596407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.596491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.596596] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1569210-7f11-407a-992e-cc729f87d941 is going to be updated. [ 1844.626161] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.626161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.626161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.626161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.626161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.633605] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: IN_PROGRESS for 2s [ 1844.688417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.688417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.688417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.688417] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.688417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.689235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.689235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.689235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.689235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.689235] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1844.837255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.837447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.837523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.837771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.837873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.838090] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.838204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.840599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.840599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.840599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.840599] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1844.865815] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.865815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.865815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.865815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.865815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.876550] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1844.889032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.889177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.889177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.889333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.889424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.889992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be created. [ 1844.912979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1844.914257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1844.914257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1844.914257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1844.914257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1844.923358] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: UNINITIALIZED for 2s [ 1845.193585] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1845.212012] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1845.212122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1845.212210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1845.212399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1845.230811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1845.231110] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1845.231249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1845.231318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1845.231511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1845.231595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1845.231806] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1845.231920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1845.231951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1845.232119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1845.232197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1845.233020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1845.233020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1845.233020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1845.233020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1845.233020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1845.233020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1845.297227] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1845.297401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1845.297483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1845.297722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1845.297878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1845.310972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1846.643560] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1569210-7f11-407a-992e-cc729f87d941 in Status: SUCCESS [ 1846.643875] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1569210-7f11-407a-992e-cc729f87d941 deletion is rescheduled due to dependency. [ 1846.643996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.886490] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1846.886490] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1846.886490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.933422] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1846.933422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.933422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.933422] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.324709] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1847.324709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.382681] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fc940ed-8b93-488d-a7ec-9852d95dc951 req-27cbf46e-3a33-40b3-942f-1ab1f1783b48 tempest-InstanceActionsV221TestJSON-956999603 tempest-InstanceActionsV221TestJSON-956999603-project-member] Enqueued Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1847.383343] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1847.383716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.383890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.383940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.384356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.384526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.384634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.384699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.384859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.385046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.385046] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.435409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.436016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.436016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.436016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.436145] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.436387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.436387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.436529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.436644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.436762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.436944] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.437098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.437306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.437362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.437489] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.437577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.437639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.437777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.437853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.437948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.438051] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.750072] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.751290] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-84" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.751526] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-84" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.751918] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-84" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.752314] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.752595] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.753180] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.753604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.754229] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.754778] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1847.755093] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1847.755490] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1847.755812] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1847.756151] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1847.756509] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1847.757479] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1847.778742] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1847.778946] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1847.779369] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1847.779369] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-84" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.779622] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-b5803b62-52f0-4ecf-9d94-275416548fce taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.780342] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.780342] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.780445] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.780524] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5803b62-52f0-4ecf-9d94-275416548fce',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.868726] env[71051]: INFO networking_nsxv3.common.synchronization [req-6a2ce88d-ff7c-493a-a242-a33303ba4aac req-01032a0f-cdf3-4b65-bb99-d6c147ba4f2c tempest-ServerMetadataTestJSON-1595872334 tempest-ServerMetadataTestJSON-1595872334-project-member] Enqueued Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1847.869338] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGHEST for action security_group_members [ 1847.869661] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.869787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.869856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.870359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.870531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.870640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.870717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.870870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.870963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.871071] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.886983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.887119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.887188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.887371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.887460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.887637] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.887735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.887797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.887948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.888038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.888163] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d596f8-78af-47cb-8580-3aab27bce04e already deleted. [ 1847.888197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.940494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5eb464e-e67c-4198-8c57-fbece9dc1535: rpc.has_security_group_logging(os_id): False [ 1847.957492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.957690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.957808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.957978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.958085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.958299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.958456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.958528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.958688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.958768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.958952] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.959062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.959125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.959263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.959339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.959517] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.959610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1847.959671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1847.959807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1847.959881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1847.959967] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be created. [ 1848.016795] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.016965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.017092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.017241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.017418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.027457] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1848.284405] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.285500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.285500] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.285742] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.286038] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.286305] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port b5803b62-52f0-4ecf-9d94-275416548fce not found, creating... [ 1848.287265] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.287265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.287265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.288077] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.288077] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.288237] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.288718] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.288718] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.289055] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.289120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.289914] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: b5803b62-52f0-4ecf-9d94-275416548fce is going to be created. [ 1848.309131] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.309400] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.309549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.309849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.310129] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.310384] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.373485] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.373642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.373720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.374012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.374130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.374345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.374464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.374530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.374704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.374786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.374891] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 is going to be updated. [ 1848.412314] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.412879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1848.412879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1848.412879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1848.412879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1848.431439] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: IN_PROGRESS for 2s [ 1849.003332] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fc940ed-8b93-488d-a7ec-9852d95dc951 req-db4e4c48-a104-41db-b4a6-381e86eb18b7 service nova] Enqueued Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_rules [ 1849.003736] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fc940ed-8b93-488d-a7ec-9852d95dc951 req-db4e4c48-a104-41db-b4a6-381e86eb18b7 service nova] Enqueued Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1849.003736] env[71051]: INFO networking_nsxv3.common.synchronization [req-5fc940ed-8b93-488d-a7ec-9852d95dc951 req-db4e4c48-a104-41db-b4a6-381e86eb18b7 service nova] Enqueued Resource ID: b5803b62-52f0-4ecf-9d94-275416548fce with Priority: HIGHEST for action port [ 1849.003995] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_rules [ 1849.004085] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1849.004214] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5803b62-52f0-4ecf-9d94-275416548fce with Priority: HIGHEST for action port [ 1849.004807] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.004936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.005019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.005432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.005521] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.006348] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.006462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.007046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.007046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.007046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.007046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.007046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.007537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.007537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1849.007537] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.009823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5803b62-52f0-4ecf-9d94-275416548fce taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.009954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.010066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.010204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.010286] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5803b62-52f0-4ecf-9d94-275416548fce',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.512260] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.513464] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.513591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.514114] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5803b62-52f0-4ecf-9d94-275416548fce with status ACTIVE [ 1849.514281] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.514394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.514455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.514671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.514765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1849.514983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.515152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.515214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.515372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.515453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1849.515650] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.515745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.515799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.515943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.516062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1849.516121] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5803b62-52f0-4ecf-9d94-275416548fce is going to be updated. [ 1849.544674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.544865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1849.544865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1849.545068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1849.545223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1849.545396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5803b62-52f0-4ecf-9d94-275416548fce" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.014778] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1850.040834] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1850.041099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.440008] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 in Status: SUCCESS [ 1850.440590] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 deletion is rescheduled due to dependency. [ 1850.440590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.517586] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1850.517791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1850.517841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1850.518156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1850.518294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.518422] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d596f8-78af-47cb-8580-3aab27bce04e is going to be created. [ 1850.546642] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1850.546642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1850.546642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1850.546642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1850.546642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.553324] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: UNINITIALIZED for 2s [ 1850.646305] env[71051]: INFO networking_nsxv3.common.synchronization [req-337e64ba-a793-403e-bb65-29f44a4f451f req-d077d29c-7878-4b6d-a9e3-42a7669641c3 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1850.646879] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1850.647474] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1850.647474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1850.647620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1850.647798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1850.647902] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1850.648175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1850.648175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1850.648252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1850.648299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1850.648396] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1851.150677] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1851.653150] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1852.155597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1852.156171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1852.156171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1852.156171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1852.156171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1852.156315] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1852.185393] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1852.185560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1852.185690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1852.185863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1852.186061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1852.194174] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1852.563236] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: SUCCESS [ 1852.563473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1852.563636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1852.563855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1852.564102] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1852.564235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1852.564303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1852.564454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1852.564539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1852.564625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1852.564715] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1853.066928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.070904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.070904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.070904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.070904] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.071672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.071672] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1853.572976] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d596f8-78af-47cb-8580-3aab27bce04e: rpc.has_security_group_logging(os_id): False [ 1853.594084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.594260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.594356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.594545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.594740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.594826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.594952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.595054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.595217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.595300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.595500] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.595616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.595676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.595816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.595901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.596093] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.596181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.596366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.596501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.596501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.596553] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d596f8-78af-47cb-8580-3aab27bce04e is going to be created. [ 1853.673798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1853.674014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1853.674093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1853.674309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1853.674494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1853.686960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: IN_PROGRESS for 2s [ 1854.203320] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1854.203610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1855.648124] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1855.648518] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1855.699999] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: SUCCESS [ 1855.699999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.577268] env[71051]: INFO networking_nsxv3.common.synchronization [None req-dccb9086-9f46-459e-b961-29a81eba7380 None None] Enqueued Resource ID: 61df3434-c228-49f2-b624-01d92fa4b183 with Priority: HIGHEST for action port [ 1856.577543] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61df3434-c228-49f2-b624-01d92fa4b183 with Priority: HIGHEST for action port [ 1856.578142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-61df3434-c228-49f2-b624-01d92fa4b183 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.578291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61df3434-c228-49f2-b624-01d92fa4b183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.578357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61df3434-c228-49f2-b624-01d92fa4b183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.578598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61df3434-c228-49f2-b624-01d92fa4b183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.578683] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61df3434-c228-49f2-b624-01d92fa4b183',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.080751] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61df3434-c228-49f2-b624-01d92fa4b183 [ 1857.081076] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.081234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.082014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.082014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.082014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.082014] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61df3434-c228-49f2-b624-01d92fa4b183 already deleted. [ 1857.082014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61df3434-c228-49f2-b624-01d92fa4b183" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1858.851178] env[71051]: INFO networking_nsxv3.common.synchronization [req-636213af-a942-4be6-86ce-9c4d4c5b161d req-43167180-64a5-4db5-86ba-b456c834c1db tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1858.851701] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1858.852061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1858.852188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1858.852254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1858.852448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1858.852598] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1858.852690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1858.852748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1858.852887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1858.852998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1858.853127] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1858.902937] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3c8b7590-8234-40c6-a393-9b976f25a8a5 None None] Enqueued Resource ID: 3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f with Priority: HIGHEST for action port [ 1858.904963] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f with Priority: HIGHEST for action port [ 1858.904963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1858.904963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1858.904963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1858.904963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1858.904963] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1859.356848] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1859.406640] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f [ 1859.406874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.407050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.407134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.407345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.407437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.407534] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f already deleted. [ 1859.407616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b6fd8f7-0b3f-4cbe-931c-737ebb6b207f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.457278] env[71051]: INFO networking_nsxv3.common.synchronization [req-1a07b7af-d20b-479c-81c7-c46122f44a0c req-1fd8ecce-4781-4cca-945c-99e0a37be8ac tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1859.458035] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1859.458162] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.458294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.458365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.458563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.458713] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.458804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.458867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.459012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.459101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.459191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1859.730801] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.730801] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.730959] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.731279] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.731619] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.732119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.732119] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.732405] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.732699] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.733089] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1859.733358] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1859.733624] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1859.733887] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1859.734181] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1859.734423] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1859.734638] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1859.755972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1859.756166] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1859.756315] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1859.756490] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.756796] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4270b089-af02-4158-a495-432c1f7d6540 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.756973] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.757114] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.757427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.757580] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4270b089-af02-4158-a495-432c1f7d6540',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1859.860802] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1859.963192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.963373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.963460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.963717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.963827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.964133] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.964247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.964333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.964497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.964590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.964687] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1859.989980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1859.990110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1859.990154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1859.990340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1859.990753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1859.998542] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1860.050952] env[71051]: INFO networking_nsxv3.common.synchronization [req-a7489c8e-68de-4ffe-9667-5fd699950e99 req-535c328a-e935-448a-bd1b-0bb4a443a2a2 tempest-InstanceActionsV221TestJSON-956999603 tempest-InstanceActionsV221TestJSON-956999603-project-member] Enqueued Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1860.051544] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d596f8-78af-47cb-8580-3aab27bce04e with Priority: HIGHEST for action security_group_members [ 1860.051903] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d596f8-78af-47cb-8580-3aab27bce04e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.056094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.056213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.056551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.056873] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.056873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.056873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.057013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.057047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.057177] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d596f8-78af-47cb-8580-3aab27bce04e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1860.260628] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.260768] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.261643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.261643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.261643] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.261643] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4270b089-af02-4158-a495-432c1f7d6540 not found, creating... [ 1860.261867] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.261931] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.262076] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.262389] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.262610] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.263022] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.263275] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.263467] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.263775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.264041] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.264253] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4270b089-af02-4158-a495-432c1f7d6540 is going to be created. [ 1860.285839] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.287453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.287453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.290159] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.291637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.291637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.363868] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.364096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.364170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.364383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.364471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.364566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1860.394862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.395115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.395190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.395405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.395584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.408229] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1860.560725] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.560884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.560973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.561242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.561346] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.561545] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.561666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.561731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.561894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.561966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.562089] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d596f8-78af-47cb-8580-3aab27bce04e is going to be updated. [ 1860.586343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.587038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.587038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.587038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.587038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.602192] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: IN_PROGRESS for 2s [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [req-1a07b7af-d20b-479c-81c7-c46122f44a0c req-88e164d8-2084-43f0-95c1-98f08cdc16cb service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [req-1a07b7af-d20b-479c-81c7-c46122f44a0c req-88e164d8-2084-43f0-95c1-98f08cdc16cb service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [req-1a07b7af-d20b-479c-81c7-c46122f44a0c req-88e164d8-2084-43f0-95c1-98f08cdc16cb service nova] Enqueued Resource ID: 4270b089-af02-4158-a495-432c1f7d6540 with Priority: HIGHEST for action port [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1860.988299] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4270b089-af02-4158-a495-432c1f7d6540 with Priority: HIGHEST for action port [ 1860.992259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.992259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.992259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.992259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.992259] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1860.993150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.994551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.994551] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4270b089-af02-4158-a495-432c1f7d6540 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.994551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.994551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.994909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.995225] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4270b089-af02-4158-a495-432c1f7d6540',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1861.500027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.500027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4270b089-af02-4158-a495-432c1f7d6540 with status ACTIVE [ 1861.500027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.500027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.500027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.500027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.500582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.500582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.500582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.500582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.500582] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4270b089-af02-4158-a495-432c1f7d6540 is going to be updated. [ 1861.520204] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.520336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.520392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.520639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.520887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.521138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4270b089-af02-4158-a495-432c1f7d6540" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1862.008525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1862.008525] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1862.008918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1862.008918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1862.009012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1862.010103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1862.010103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1862.010103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1862.010103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1862.010103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1862.010103] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1862.418311] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1862.418621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1862.512175] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1862.611446] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d596f8-78af-47cb-8580-3aab27bce04e in Status: SUCCESS [ 1862.611640] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d596f8-78af-47cb-8580-3aab27bce04e deletion is rescheduled due to dependency. [ 1862.611788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d596f8-78af-47cb-8580-3aab27bce04e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.014456] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1863.331638] env[71051]: INFO networking_nsxv3.common.synchronization [req-0b6e01ec-e115-4132-a318-83afd0a7aaad req-95f4a862-9cf2-4e38-8e5b-f779f9ead27b tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1863.332257] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1863.332575] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.332702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.332771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.333050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.333238] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.333364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.333530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.333714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.333802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.333920] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1863.516919] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.517111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.517186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.517402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.517496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.517679] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1863.551116] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.551253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.551292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.551538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.551632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.560383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1863.651501] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.651714] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.652012] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.652319] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.652755] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.652951] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.653244] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.653593] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.653672] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.653893] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1863.654094] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1863.654166] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1863.654285] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1863.654444] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1863.655698] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1863.655698] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1863.684239] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1863.684428] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1863.686478] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1863.686478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.686478] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-e1a189d3-c744-471b-b3f6-29b9292f6683 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.686478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.686478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.686478] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.686478] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a189d3-c744-471b-b3f6-29b9292f6683',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1863.836737] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.836867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.836908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.837153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.837246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.837450] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1863.837552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1863.837616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1863.837764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1863.837841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1863.837925] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da already deleted. [ 1863.838015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.188525] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.188827] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.188915] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.189310] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.189515] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.189715] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port e1a189d3-c744-471b-b3f6-29b9292f6683 not found, creating... [ 1864.190059] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.190278] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.190418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.190650] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.190799] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.191159] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.191369] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.191524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.191776] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.191978] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.192196] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: e1a189d3-c744-471b-b3f6-29b9292f6683 is going to be created. [ 1864.221652] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.221871] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.222028] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.222336] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.222641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.222888] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.882858] env[71051]: INFO networking_nsxv3.common.synchronization [req-0b6e01ec-e115-4132-a318-83afd0a7aaad req-890da829-dfdf-4c2a-b134-000c83d4c984 service nova] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_rules [ 1864.883071] env[71051]: INFO networking_nsxv3.common.synchronization [req-0b6e01ec-e115-4132-a318-83afd0a7aaad req-890da829-dfdf-4c2a-b134-000c83d4c984 service nova] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1864.883239] env[71051]: INFO networking_nsxv3.common.synchronization [req-0b6e01ec-e115-4132-a318-83afd0a7aaad req-890da829-dfdf-4c2a-b134-000c83d4c984 service nova] Enqueued Resource ID: e1a189d3-c744-471b-b3f6-29b9292f6683 with Priority: HIGHEST for action port [ 1864.883468] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_rules [ 1864.883569] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1864.883666] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a189d3-c744-471b-b3f6-29b9292f6683 with Priority: HIGHEST for action port [ 1864.884479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.884650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.884750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.885076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.885221] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1864.886186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.886323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.886692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.886692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.886876] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.887020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.887129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.887343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.887500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1864.887629] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1864.888447] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a189d3-c744-471b-b3f6-29b9292f6683 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1864.888604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1864.888766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1864.888964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1864.889102] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a189d3-c744-471b-b3f6-29b9292f6683',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1865.391074] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1865.391972] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.392104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.392254] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1a189d3-c744-471b-b3f6-29b9292f6683 with status ACTIVE [ 1865.392824] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.392824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.392824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.392824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.392998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.393036] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.393167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.393167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.393326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.393406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.393606] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.393718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.393839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.393926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.394033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.394131] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1a189d3-c744-471b-b3f6-29b9292f6683 is going to be updated. [ 1865.418740] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.418740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.418740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.418740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.418740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.418740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a189d3-c744-471b-b3f6-29b9292f6683" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.570218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1865.570487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.571365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.571365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.571365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1865.571365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1865.571365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1865.571610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1865.571610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.571661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.571739] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1865.898028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1866.074527] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.074701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.074774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.075033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.075218] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.075320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.075610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.075797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.075891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.075986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.076153] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.076252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.076336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.078072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.078072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.078072] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1866.400142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.400647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.400647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.400647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.400960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.400960] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be created. [ 1866.444420] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.444561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.444633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.444844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.445008] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.458043] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: UNINITIALIZED for 2s [ 1866.580255] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1866.601057] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.601359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.601441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.601658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.602580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.602675] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.602801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.602855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.603245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.603245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.603392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.603392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.603505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.603805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.603805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.603942] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.603942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.604217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.604377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.604456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.604547] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1866.681630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1866.681630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1866.681630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1866.681630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1866.681630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1866.699020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1867.133216] env[71051]: INFO networking_nsxv3.common.synchronization [req-fe399668-277f-4821-95df-48b76602d637 req-eadca07e-ba74-4c58-9559-230278e03f1b tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1867.133216] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1867.133216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.133216] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.133216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1867.133216] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1867.566709] env[71051]: INFO networking_nsxv3.common.synchronization [req-e6647098-94aa-4305-bdc2-d9329612a39c req-3becea63-fcfb-49a5-bfa9-8f377b7eeb75 tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1867.567289] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1867.567671] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.567776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.567854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.568092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.568265] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.568388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.568454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.568636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.568743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1867.568850] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1867.639022] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1867.930885] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.930972] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.931032] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.931364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.931636] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.931805] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.931930] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.932206] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.932366] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1867.932578] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1867.932699] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1867.932817] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1867.932930] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1867.933060] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1867.933172] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1867.933309] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1867.964852] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1867.964852] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1867.964852] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1867.965074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-886" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1867.965777] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1867.965777] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1867.965777] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1867.965979] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1867.966035] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('258afdef-75f3-46c7-aa8b-dc6c1ed18a52',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1868.071239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.071481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.071597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.071939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.072121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.072444] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.073128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.073128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.073128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.073128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.073382] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1868.099032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.099890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.099890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.099890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.099890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.110082] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1868.141091] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1868.467354] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 1868.467578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.468123] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.468328] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.468460] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.468725] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.468876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.469045] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 not found, creating... [ 1868.469309] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.469477] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.469609] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.469846] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.470009] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.470351] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.470518] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.470642] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.470858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.471000] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.471174] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 is going to be created. [ 1868.472087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.472246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.472397] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.472496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.472560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.472698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.472799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.472871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.472956] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1868.489764] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.489948] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.490094] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.490329] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.490544] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.490756] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.644295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.644595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.644595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.644757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.644845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.644910] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1868.681261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.681417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.681470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.681691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.681837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.690535] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1868.715352] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1868.715587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.974879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.975121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.975121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.975328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.975492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.975591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.975652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.975794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.975876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.975961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.976118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.976207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.976265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.976434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.976568] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1868.976658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1868.976716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1868.976853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1868.976927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.977017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1868.977607] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1869.411774] env[71051]: INFO networking_nsxv3.common.synchronization [req-e6647098-94aa-4305-bdc2-d9329612a39c req-fb64b255-6afd-439e-9240-47d40879e741 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1869.411993] env[71051]: INFO networking_nsxv3.common.synchronization [req-e6647098-94aa-4305-bdc2-d9329612a39c req-fb64b255-6afd-439e-9240-47d40879e741 service nova] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1869.412173] env[71051]: INFO networking_nsxv3.common.synchronization [req-e6647098-94aa-4305-bdc2-d9329612a39c req-fb64b255-6afd-439e-9240-47d40879e741 service nova] Enqueued Resource ID: 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 with Priority: HIGHEST for action port [ 1869.412420] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_rules [ 1869.412551] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1869.412649] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 with Priority: HIGHEST for action port [ 1869.413459] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.413847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.413927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.414617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.414617] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1869.418951] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.418951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.418951] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.418951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.418951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.418951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.418951] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('258afdef-75f3-46c7-aa8b-dc6c1ed18a52',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1869.479784] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbb6d1cf-c327-4448-b44d-5e5de4b300da: rpc.has_security_group_logging(os_id): False [ 1869.498642] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.498781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.498818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.499027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.499142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.499396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.499517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.499576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.499742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.499823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.500040] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.500142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.500202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.500348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.500423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.500602] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.500691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.500753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.500892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.500968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.501072] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be created. [ 1869.563393] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.563546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.563584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.563777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.563949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.575316] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 1869.916043] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.916043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.919470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 with status ACTIVE [ 1869.919704] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.919857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.919912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.920144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.920245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.920422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.920530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.920592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.920764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.920824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.921015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.921126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.921213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.921360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.921434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.921565] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 258afdef-75f3-46c7-aa8b-dc6c1ed18a52 is going to be updated. [ 1869.946029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1869.946029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1869.946029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1869.946029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1869.946029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1869.946029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-258afdef-75f3-46c7-aa8b-dc6c1ed18a52" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1870.120563] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1870.120723] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1870.120789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1870.121056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1870.121371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1870.121646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1870.121836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1870.121972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1870.122231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1870.122370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1870.122521] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1870.627462] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1870.700493] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1870.700493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1871.131189] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1871.588244] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 1871.592150] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1871.637865] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1871.637865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1871.637865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1871.637865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1871.637865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1871.637865] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1871.665557] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1871.665557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1871.665557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1871.665557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1871.665557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1871.673278] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1871.992672] env[71051]: INFO networking_nsxv3.common.synchronization [req-918980b9-0758-4156-bf7c-11d6716b8e53 req-03ea4e17-5c8f-406f-b395-9ffe20a52240 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1871.993540] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1871.993792] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1871.993924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1871.994248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1871.994248] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1871.994378] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1871.994594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1871.994594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1871.994679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1871.994757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1871.994824] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1872.497373] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1873.000216] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1873.502499] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.502811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.502811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.502923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.503295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.503295] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1873.531062] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.531062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.531062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.531062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.531286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.539181] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1873.682254] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1873.682477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.682640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.682853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.683055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.683181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.683253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.683395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.683477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.683559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.683650] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1874.186102] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.186298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.186375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.186601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.186777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.186874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.186941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.187142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.187244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.187322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.187458] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.187549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.187618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.187749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.187887] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.187987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.188045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.188288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.188288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.188367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.188445] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1874.690936] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bba870c-b5d9-4661-a3d0-55e05367a8db: rpc.has_security_group_logging(os_id): False [ 1874.710638] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.710638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.710638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.710638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.710899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.712059] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.712059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.712059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.712059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.712059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.712296] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.712410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.712476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.712632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.712727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.712920] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.713027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.713080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.713227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.713307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.713392] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1874.795652] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.795802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.796155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.796418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.796575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.810700] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1874.912154] env[71051]: INFO networking_nsxv3.common.synchronization [req-0eacd667-67e1-4c0c-ad6e-7e40b8874b67 req-f50d329c-fc19-48dc-8a3d-d5e619b6ee07 tempest-ServersNegativeTestJSON-1063350002 tempest-ServersNegativeTestJSON-1063350002-project-member] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1874.912865] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1874.913430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.913430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.913528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.913841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.914078] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.914226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.914321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.914537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.914657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.914781] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1875.195054] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.195265] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.195422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.195744] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.196018] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.196192] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.196320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.196545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.196698] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.196927] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1875.197062] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1875.197184] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1875.197355] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1875.197549] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1875.197685] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1875.197832] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1875.216187] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1875.216346] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1875.216487] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1875.216655] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.216954] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-55633c87-2423-4570-bbb2-7c73a6ddf16f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.217138] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.217266] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.217606] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.217757] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55633c87-2423-4570-bbb2-7c73a6ddf16f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1875.416794] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.416970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.417027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.417253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.417446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.417645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.417746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.417809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.417971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.418067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.418156] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 already deleted. [ 1875.418239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.549039] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1875.549296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.720738] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.721181] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.721359] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.721692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.721833] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.722011] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 55633c87-2423-4570-bbb2-7c73a6ddf16f not found, creating... [ 1875.722377] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.722507] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.722635] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.722898] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.723075] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.723779] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.723779] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.723779] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.723938] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.724121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.724272] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f is going to be created. [ 1875.743457] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.743690] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.743820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.744168] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.744417] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1875.744651] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.410047] env[71051]: INFO networking_nsxv3.common.synchronization [req-0eacd667-67e1-4c0c-ad6e-7e40b8874b67 req-cf9e3efb-9d92-4896-9281-2fc690f61d85 service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1876.410357] env[71051]: INFO networking_nsxv3.common.synchronization [req-0eacd667-67e1-4c0c-ad6e-7e40b8874b67 req-cf9e3efb-9d92-4896-9281-2fc690f61d85 service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1876.410521] env[71051]: INFO networking_nsxv3.common.synchronization [req-0eacd667-67e1-4c0c-ad6e-7e40b8874b67 req-cf9e3efb-9d92-4896-9281-2fc690f61d85 service nova] Enqueued Resource ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f with Priority: HIGHEST for action port [ 1876.411075] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1876.411237] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1876.411338] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f with Priority: HIGHEST for action port [ 1876.411627] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.411754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.411837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.412144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.412268] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.413165] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.413267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.413313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.413458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.413619] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.413748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.413784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.414408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.414506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.414603] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.415403] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-55633c87-2423-4570-bbb2-7c73a6ddf16f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.415547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.415595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.415749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.415825] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55633c87-2423-4570-bbb2-7c73a6ddf16f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.825240] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1876.825240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.917883] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.918100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.918325] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.919331] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55633c87-2423-4570-bbb2-7c73a6ddf16f with status ACTIVE [ 1876.919508] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.919627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.919696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.919899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.919991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.920227] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.920343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.920408] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.920601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.920689] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.920899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.920998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.921097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.921431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.921431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.921431] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f is going to be updated. [ 1876.941107] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.941276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.941360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.941541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.941681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.941847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.424229] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.928372] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.928687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.928687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.928832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.928923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.929035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be created. [ 1877.950779] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.950908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.950992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.951196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.951375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.963876] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: UNINITIALIZED for 2s [ 1878.911997] env[71051]: INFO networking_nsxv3.common.synchronization [req-f7c43364-09ca-4d3e-a5b2-d302e6505803 req-9c93a338-4ba5-4c38-8513-9a44d146c2d7 tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1878.912571] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1878.912874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1878.913266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1878.913266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1878.913266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1878.913439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1878.913510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1878.913558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1878.913682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1878.913768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1878.913856] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.416761] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.919534] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.978012] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1879.978284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1879.978783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1879.978996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1879.979223] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1879.979348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1879.979439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1879.979616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1879.979704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1879.979789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1879.980201] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1880.422099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.422381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.422381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.422544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.422676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.422808] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1880.453425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.453555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.453630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.453841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.453982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.463497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1880.481728] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.481872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.481949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.482290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.482493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.482616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.482650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.482797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.482886] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.482976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.483140] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.483231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.483293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.483654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.483654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1880.483654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1880.483794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1880.483835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1880.483914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.483994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1880.484126] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1880.986572] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 371c9558-8dd8-4739-882d-f7fbf1f26c54: rpc.has_security_group_logging(os_id): False [ 1881.004411] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.004567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.004623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.005325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.005325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.005325] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.005325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.005325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.005707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.005707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.005762] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.005844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.005890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.009740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.010865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.011105] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.011216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.011280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.011435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.011518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.011609] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be created. [ 1881.067186] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.067349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.067420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.067628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.067865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.078785] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1881.174455] env[71051]: INFO networking_nsxv3.common.synchronization [req-dc0fab6f-f851-4299-9985-663174dd3fa6 req-12108641-5dd7-468e-911e-71afd7ccfb6d tempest-ServerRescueTestJSON-877836862 tempest-ServerRescueTestJSON-877836862-project-member] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1881.175536] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1881.175536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.175536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.175536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.175745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.175840] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.175952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.176153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.176378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.176490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.176592] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.462887] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.463191] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.463243] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.463514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.463783] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.463946] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.464102] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.464329] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.464484] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.464699] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1881.464818] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1881.464931] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1881.465058] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1881.465176] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1881.465287] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1881.465425] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1881.483242] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1881.483392] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1881.483531] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1881.483690] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-174" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.483955] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ee534f5f-7e34-4794-afc2-b593ca71ae0e taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.484160] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.484296] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.484577] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.484724] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee534f5f-7e34-4794-afc2-b593ca71ae0e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.679021] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.988232] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.988567] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.988751] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.989111] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.989311] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.989494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ee534f5f-7e34-4794-afc2-b593ca71ae0e not found, creating... [ 1881.989782] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.989952] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.990093] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.990379] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.990551] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.990935] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.991164] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.991361] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.991712] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.991863] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.992050] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ee534f5f-7e34-4794-afc2-b593ca71ae0e is going to be created. [ 1882.010912] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.011194] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.011331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.011604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.011831] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.012104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.181839] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1882.472944] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1882.473218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.684611] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.684769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.684840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.685084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.686183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.686183] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be updated. [ 1882.713480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.713634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.713691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.713894] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.714050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.723200] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1882.729913] env[71051]: INFO networking_nsxv3.common.synchronization [req-dc0fab6f-f851-4299-9985-663174dd3fa6 req-1a71b08f-6f80-451e-b5d5-a525e9c8d88f service nova] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_rules [ 1882.730116] env[71051]: INFO networking_nsxv3.common.synchronization [req-dc0fab6f-f851-4299-9985-663174dd3fa6 req-1a71b08f-6f80-451e-b5d5-a525e9c8d88f service nova] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1882.730299] env[71051]: INFO networking_nsxv3.common.synchronization [req-dc0fab6f-f851-4299-9985-663174dd3fa6 req-1a71b08f-6f80-451e-b5d5-a525e9c8d88f service nova] Enqueued Resource ID: ee534f5f-7e34-4794-afc2-b593ca71ae0e with Priority: HIGHEST for action port [ 1882.730545] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_rules [ 1882.730609] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1882.730708] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee534f5f-7e34-4794-afc2-b593ca71ae0e with Priority: HIGHEST for action port [ 1882.731249] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.731373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.731441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.731671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.731708] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1882.732933] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.733099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.733227] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee534f5f-7e34-4794-afc2-b593ca71ae0e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.733328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.733385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.733546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.733622] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee534f5f-7e34-4794-afc2-b593ca71ae0e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1883.090656] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1883.090974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.235631] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.235814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.235950] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee534f5f-7e34-4794-afc2-b593ca71ae0e with status ACTIVE [ 1883.236147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.236261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.236329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.236555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.236649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.236830] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.236943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.237015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.237225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.237316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.237504] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.237598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.237659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.237802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.237877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.237963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee534f5f-7e34-4794-afc2-b593ca71ae0e is going to be updated. [ 1883.256777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.256964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.257010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.257223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.257356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.257518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee534f5f-7e34-4794-afc2-b593ca71ae0e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.732423] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1884.732753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.732938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.733616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.733616] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1884.733616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1884.733616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.733853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.733977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.734142] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1884.936925] env[71051]: INFO networking_nsxv3.common.synchronization [req-ccc314a8-9c4f-427d-be1e-39d20459fc0f req-e7ca7c38-96e4-4cfe-b65d-19e0f9b4f425 tempest-ServerRescueNegativeTestJSON-1364452792 tempest-ServerRescueNegativeTestJSON-1364452792-project-member] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1884.936925] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGHEST for action security_group_members [ 1884.937019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1884.937113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1884.937184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.937376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.937526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1884.937619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1884.937678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.937813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.937912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.937983] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1885.236868] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1885.439729] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1885.439895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1885.439975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1885.440200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1885.440303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1885.440505] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1885.440602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1885.440669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1885.440825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1885.440903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1885.440991] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be updated. [ 1885.466533] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1885.466765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1885.466843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1885.467069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1885.467244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1885.477219] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: IN_PROGRESS for 2s [ 1885.739848] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1886.242356] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1886.242549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1886.242549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1886.242732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1886.242821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1886.242924] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be updated. [ 1886.270150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1886.270322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1886.270378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1886.270540] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1886.270676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1886.279029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1887.485494] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 in Status: SUCCESS [ 1887.485799] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 deletion is rescheduled due to dependency. [ 1887.485799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.288230] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1888.288447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.288614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.288827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.289035] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1888.289218] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1888.289283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.289446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.289537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.289625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.289719] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1888.791666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1888.792214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1888.792214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.792214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.792424] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1888.792548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1888.792627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.792820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.792920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.793045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.793226] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1888.793342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1888.793409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.793592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.793759] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1888.793864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1888.793939] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1888.794104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1888.794209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.794311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1888.794417] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1889.296885] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5eb464e-e67c-4198-8c57-fbece9dc1535: rpc.has_security_group_logging(os_id): False [ 1889.315798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1889.315967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1889.316022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1889.316246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1889.316327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1889.316551] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1889.316723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1889.316723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1889.316855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1889.316931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1889.317140] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1889.317234] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1889.317296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1889.317561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1889.317561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1889.317666] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1889.317758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1889.317834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1889.317969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1889.318113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1889.318163] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be updated. [ 1889.386378] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1889.386541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1889.386591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1889.386798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1889.386945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1889.399252] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1889.937903] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1889.938393] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1890.988101] env[71051]: INFO networking_nsxv3.common.synchronization [req-dd84606b-1503-4e44-bd4c-be559c52aee6 req-8219e1ac-c306-4277-9b2d-9aee11a353fc tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1890.988659] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 with Priority: HIGHEST for action security_group_members [ 1890.989037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1890.989172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1890.989237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1890.989439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1890.989751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1890.989751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1890.989751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1890.989949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1890.989949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1890.990061] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b78d5-f56c-47e2-a26e-d87bff454fb0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1891.427207] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1891.427437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1891.493053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1891.493278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1891.493447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1891.493679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1891.493754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1891.493964] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1891.494096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1891.494271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1891.494476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1891.494564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1891.494663] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 is going to be updated. [ 1891.528601] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1891.528601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1891.528601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1891.528601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1891.528601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1891.538339] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: IN_PROGRESS for 2s [ 1893.549675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 in Status: SUCCESS [ 1893.549675] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b78d5-f56c-47e2-a26e-d87bff454fb0 deletion is rescheduled due to dependency. [ 1893.549675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b78d5-f56c-47e2-a26e-d87bff454fb0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1893.878302] env[71051]: INFO networking_nsxv3.common.synchronization [req-142d648b-b7ff-4c67-856c-550945681b5e req-ce9f77af-c203-4274-b9ad-a8bed356fbe2 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1893.879166] env[71051]: INFO networking_nsxv3.common.synchronization [req-e30fd073-4101-4061-a97c-c4f0384c06bc req-b5572751-731f-40e0-bf05-2bf416f804b6 tempest-ServersAdminTestJSON-1452941850 tempest-ServersAdminTestJSON-1452941850-project-member] Enqueued Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1893.879558] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 1893.879688] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 with Priority: HIGHEST for action security_group_members [ 1893.879960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1893.880084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1893.880154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1893.880347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1893.880544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1893.880605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1893.880685] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1893.880780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1893.880861] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1893.880949] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1893.881798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-88000fa0-ad41-4e33-a474-dbc4d09cd427 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1893.882365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1893.882449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1893.882593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1893.882735] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1893.882828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1893.882889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1893.883049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1893.883134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1893.883220] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88000fa0-ad41-4e33-a474-dbc4d09cd427',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1894.198161] env[71051]: INFO networking_nsxv3.common.synchronization [req-58b97bb1-7b2a-462b-a3a8-6f7ded5c1329 req-8f1ec0aa-c6f7-4f48-a633-20f7e8a6fc93 tempest-ServersNegativeTestJSON-1063350002 tempest-ServersNegativeTestJSON-1063350002-project-member] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1894.198161] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1894.198161] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.198161] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.198161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.198161] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1894.384692] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.384909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.384909] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.385187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.385277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.385488] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.385605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.385668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.385834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.385916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.386107] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be updated. [ 1894.387174] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.387282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.387349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.387504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.413202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.413480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.413617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.413703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.413905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.413998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.414092] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 is going to be updated. [ 1894.420686] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.420812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.420873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.421071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.421203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.428298] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 1894.439841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.439967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.440018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.440209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.440343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.447757] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: IN_PROGRESS for 2s [ 1894.486471] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.486736] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.486864] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.487171] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.487432] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.487589] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.487719] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.487938] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.488097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.488350] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1894.488417] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1894.488545] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1894.490029] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1894.490029] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1894.490029] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1894.490029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1894.508675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1894.508855] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1894.509014] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1894.509201] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1894.510032] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1894.510032] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1894.510032] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1894.510353] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1894.510412] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4855e3b6-27ee-4bb5-81b9-0961ab5edef8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1894.701057] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1895.012928] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.013198] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.013371] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.013665] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.013826] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.013988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 not found, creating... [ 1895.014321] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.014489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.014613] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.014839] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.014983] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.015351] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.015522] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.015646] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.015868] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.016024] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.016165] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 is going to be created. [ 1895.037161] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.037415] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.037549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.037815] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.038079] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.038325] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.203750] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1895.707031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.707386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.707386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.707815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.707815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.707815] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1895.735771] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.735964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.736026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.736225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.736389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1895.746758] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1895.772186] env[71051]: INFO networking_nsxv3.common.synchronization [req-58b97bb1-7b2a-462b-a3a8-6f7ded5c1329 req-d75894ac-b511-49f5-83dc-86e43f2ef52c service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1895.772614] env[71051]: INFO networking_nsxv3.common.synchronization [req-58b97bb1-7b2a-462b-a3a8-6f7ded5c1329 req-d75894ac-b511-49f5-83dc-86e43f2ef52c service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1895.772847] env[71051]: INFO networking_nsxv3.common.synchronization [req-58b97bb1-7b2a-462b-a3a8-6f7ded5c1329 req-d75894ac-b511-49f5-83dc-86e43f2ef52c service nova] Enqueued Resource ID: 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 with Priority: HIGHEST for action port [ 1895.774819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1895.774819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1895.774819] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 with Priority: HIGHEST for action port [ 1895.774819] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.774819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.774819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.774819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.774819] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1895.776980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.776980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.778092] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1895.778092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1895.778092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1895.778261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1895.778323] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4855e3b6-27ee-4bb5-81b9-0961ab5edef8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1896.280512] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.280657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1896.280866] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 with status ACTIVE [ 1896.281051] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.281177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1896.281236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1896.281457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1896.281530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.281695] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.281838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1896.281838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1896.282025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1896.282085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.282275] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.282398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1896.282460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1896.282598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1896.282674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.282757] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4855e3b6-27ee-4bb5-81b9-0961ab5edef8 is going to be updated. [ 1896.304322] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.304503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1896.304503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1896.305947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1896.305947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.305947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4855e3b6-27ee-4bb5-81b9-0961ab5edef8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.439453] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 1896.439453] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da deletion is rescheduled due to dependency. [ 1896.439453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1896.465623] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 in Status: SUCCESS [ 1896.465623] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88000fa0-ad41-4e33-a474-dbc4d09cd427 deletion is rescheduled due to dependency. [ 1896.465623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88000fa0-ad41-4e33-a474-dbc4d09cd427" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1897.759513] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1897.759799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1897.759915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1897.760139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1897.760336] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.760508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1897.760508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1897.760672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1897.760756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1897.760854] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1897.969058] env[71051]: INFO networking_nsxv3.common.synchronization [req-eaf066f8-a1ce-4060-b45e-ce49813be9e5 req-73807e6b-ae3e-4cda-b943-88e3573bec4c tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1897.969058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1897.969058] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.969764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1897.969990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1897.970341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1897.970625] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.970958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1897.972542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1897.972542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1897.972542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1897.972542] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.257305] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.257513] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.257646] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.257916] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.258208] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.258380] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.258501] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.258730] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.258879] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.259108] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1898.259232] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1898.259360] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1898.259472] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1898.259612] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1898.259746] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1898.261449] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1898.262840] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.281449] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1898.281757] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1898.281948] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1898.282831] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.282831] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2cdea57c-5bc2-4855-9091-74578a21d31b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.282968] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.283057] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.283407] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.283551] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdea57c-5bc2-4855-9091-74578a21d31b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.474201] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.765082] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.786941] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.787390] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.787517] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.787800] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.788136] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.788136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2cdea57c-5bc2-4855-9091-74578a21d31b not found, creating... [ 1898.788402] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.788571] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.788944] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.789215] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.789364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.789660] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.790156] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.790320] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.790683] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.790748] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.790898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2cdea57c-5bc2-4855-9091-74578a21d31b is going to be created. [ 1898.809212] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.809427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1898.809560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1898.809804] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1898.810051] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.810295] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1898.976098] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1899.267084] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.267284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.267350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.267523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.267615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1899.267712] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1899.293979] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.294154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.294283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.294486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.294628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1899.302898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1899.479129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.479305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.479379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.480033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.480033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1899.480033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1899.492902] env[71051]: INFO networking_nsxv3.common.synchronization [req-eaf066f8-a1ce-4060-b45e-ce49813be9e5 req-f1ef6e34-c986-49ef-b978-d109d4b0679f service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1899.495848] env[71051]: INFO networking_nsxv3.common.synchronization [req-eaf066f8-a1ce-4060-b45e-ce49813be9e5 req-f1ef6e34-c986-49ef-b978-d109d4b0679f service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1899.495848] env[71051]: INFO networking_nsxv3.common.synchronization [req-eaf066f8-a1ce-4060-b45e-ce49813be9e5 req-f1ef6e34-c986-49ef-b978-d109d4b0679f service nova] Enqueued Resource ID: 2cdea57c-5bc2-4855-9091-74578a21d31b with Priority: HIGHEST for action port [ 1899.495848] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1899.495848] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1899.495848] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdea57c-5bc2-4855-9091-74578a21d31b with Priority: HIGHEST for action port [ 1899.495848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.495848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.495848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.495848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.495848] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1899.496480] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.496648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.496792] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cdea57c-5bc2-4855-9091-74578a21d31b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.496866] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.496901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.497091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.499529] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdea57c-5bc2-4855-9091-74578a21d31b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1899.506157] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1899.506296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1899.506885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1899.506885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1899.506885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1899.515025] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1899.999628] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.000098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1900.001343] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cdea57c-5bc2-4855-9091-74578a21d31b with status ACTIVE [ 1900.001416] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.001539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1900.001660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1900.001800] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1900.001893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1900.002117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.002217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1900.002275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1900.002438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1900.002520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1900.002701] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.002793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1900.002855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1900.002998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1900.003089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1900.003175] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cdea57c-5bc2-4855-9091-74578a21d31b is going to be updated. [ 1900.024831] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.024993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1900.025082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1900.025318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1900.025525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1900.025721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cdea57c-5bc2-4855-9091-74578a21d31b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.312783] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1901.313173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.313462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.313796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.314111] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.314288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.314385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.314651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.314792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.314943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.315146] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1901.526168] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1901.526407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.526575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.526782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.526967] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.527100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.527169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.527321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.527405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.527500] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1901.819544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.819720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.819798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.820025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.820259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.820369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.820430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.820627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.820723] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.820983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.820983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.821133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.821133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.821249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.821391] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1901.821483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1901.821536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1901.821674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1901.821750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.821831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1901.821922] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1902.032939] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1902.323717] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 371c9558-8dd8-4739-882d-f7fbf1f26c54: rpc.has_security_group_logging(os_id): False [ 1902.342337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.342491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1902.342569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1902.342817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1902.342955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1902.343193] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.343312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1902.343380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1902.343543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1902.343623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1902.343812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.343910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1902.343973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1902.344127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1902.344249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1902.344468] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.344616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1902.344700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1902.344881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1902.344966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1902.345072] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1902.409015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.409171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1902.409251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1902.409542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1902.409691] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1902.421660] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1902.535976] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1903.037345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1903.037534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1903.037577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1903.037789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1903.037883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1903.037986] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1903.065866] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1903.066019] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1903.066088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1903.066298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1903.066484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1903.076905] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1904.438027] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1904.438289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1904.495806] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1904.495908] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1904.791479] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3f5f0656-41c3-4a0b-a2f8-d66601acea76 tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1904.791479] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1904.791479] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1904.791479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1904.791479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1904.791479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1904.791691] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1904.808417] env[71051]: INFO networking_nsxv3.common.synchronization [None req-dcf952e5-b636-4923-9c4d-033d48536611 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1904.808864] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1904.809352] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1904.809481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1904.809552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1904.809802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1904.809883] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1904.924328] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2615c304-f62a-43d2-9cc9-6b8283f28dff tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1904.924798] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1904.925435] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1904.925550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1904.937571] env[71051]: INFO networking_nsxv3.common.synchronization [None req-790fe09a-dd37-4835-9408-bf52a9bb5933 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1904.937571] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1904.937908] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1904.937976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.090572] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1905.091043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.091113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.091353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.091597] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.091758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.091840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.092054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.092168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.092516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.092516] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.310896] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.311065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.311142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.311359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.311455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.311547] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a44db054-67f6-416b-8627-f64892f0cf47 already deleted. [ 1905.311637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.312776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.312955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.313117] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.329801] env[71051]: INFO networking_nsxv3.common.synchronization [req-f763803b-e78b-4a91-97a4-785a7024d02a req-9afa6acf-5fce-4849-9922-27ea37abe02e tempest-ServersNegativeTestJSON-1063350002 tempest-ServersNegativeTestJSON-1063350002-project-member] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1905.331182] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1905.333235] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.333315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.333522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.333793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.334246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.334385] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 896db215-283f-4c81-b855-943659d9edda already deleted. [ 1905.334864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.334927] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.335031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.335536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.335536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.335536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.335708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.335708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.335888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.336011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.336155] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.338443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.338795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.338921] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.595451] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.595948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.595948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.595948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.596125] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.596195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.596260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.596379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.596465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.596554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.596701] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.596793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.596852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.596993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.597148] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.597289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.597289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.597428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.597506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.597587] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.597712] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.838428] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1905.840234] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.840424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.840424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.840653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.840731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.840819] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a44db054-67f6-416b-8627-f64892f0cf47 already deleted. [ 1905.840905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.859498] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1905.859660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1905.859711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1905.860104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1905.860104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1905.860209] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 896db215-283f-4c81-b855-943659d9edda already deleted. [ 1905.860284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.100044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1906.119217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.120260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.120341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.120551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.120641] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.120847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.120948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.121023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.121183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.121245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.121448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.121546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.121612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.121748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.121820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.121998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.123109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.123423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.123667] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.123950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.124584] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1906.211939] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.212116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.212257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.212452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.212606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.228998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1906.343625] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1906.845863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.846290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.846290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.846594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.846594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.846675] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1906.873156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1906.873273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1906.873342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1906.873572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1906.873709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1906.883250] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1907.228856] env[71051]: INFO networking_nsxv3.common.synchronization [req-73fdc90c-dccc-4030-8f33-6b5ca42d98fe req-104efffb-82a2-4bd5-9dc3-2550ffe1c1cc tempest-ServerRescueTestJSON-877836862 tempest-ServerRescueTestJSON-877836862-project-member] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1907.229372] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1907.229699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1907.229793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1907.229857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1907.230223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1907.231413] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1907.231413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1907.231413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1907.231413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1907.231413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1907.231413] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1907.732878] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1908.235020] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1908.245802] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1908.246625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1908.737028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1908.737256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1908.737354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1908.737613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1908.737726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1908.737907] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be updated. [ 1908.765813] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1908.766147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1908.766258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1908.766498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1908.766676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1908.774984] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1908.893679] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1908.893879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1909.934258] env[71051]: INFO networking_nsxv3.common.synchronization [req-0b42931f-770a-43c1-b094-7513b17e5b02 req-17ead24a-b97f-4822-adb6-9d02320a4d31 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1909.937405] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1909.938239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1909.938489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1909.938635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1909.938950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1909.939200] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1909.939425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1909.939573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1909.939851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1909.940054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1909.940273] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1910.443054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1910.443259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1910.443301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1910.443523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1910.443621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1910.443823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1910.443923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1910.443985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1910.444155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1910.444233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1910.444367] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1910.474039] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1910.474117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1910.474309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1910.474431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1910.474575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1910.483380] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1910.785768] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1910.786271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1911.468628] env[71051]: INFO networking_nsxv3.common.synchronization [None req-95cef79c-e600-41b2-9dbf-fc1a4bafa023 None None] Enqueued Resource ID: bb202d46-0e29-441a-9038-18c26a0803e7 with Priority: HIGHEST for action port [ 1911.469150] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb202d46-0e29-441a-9038-18c26a0803e7 with Priority: HIGHEST for action port [ 1911.469462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb202d46-0e29-441a-9038-18c26a0803e7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1911.469586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb202d46-0e29-441a-9038-18c26a0803e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1911.469647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb202d46-0e29-441a-9038-18c26a0803e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1911.469921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb202d46-0e29-441a-9038-18c26a0803e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1911.472456] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb202d46-0e29-441a-9038-18c26a0803e7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1911.958974] env[71051]: INFO networking_nsxv3.common.synchronization [req-ff645bcd-6e4e-45df-a71d-11b563cf91ef req-2a6658c5-4d69-461c-8c97-2b00758bf3fb tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 1911.959655] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 1911.959826] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1911.959983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1911.960041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1911.960918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1911.961183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1911.961284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1911.961351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1911.961539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1911.961632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1911.961843] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1911.976998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb202d46-0e29-441a-9038-18c26a0803e7 [ 1911.976998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1911.976998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1911.977225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1911.977325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1911.977393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1911.977497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb202d46-0e29-441a-9038-18c26a0803e7 already deleted. [ 1911.977612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb202d46-0e29-441a-9038-18c26a0803e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.135095] env[71051]: INFO networking_nsxv3.common.synchronization [req-701fc4e3-4e95-446d-821b-2970ba69b77e req-4ea5cc70-76f6-4fcf-8162-765fb04655ec tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1912.135908] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1912.136258] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.136388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.136459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.136780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.136946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.137287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.137373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.137545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.137664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.137752] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1912.283055] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.283280] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.283411] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.283687] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.283947] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.284123] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.284327] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.284506] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.284661] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.284877] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1912.284995] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1912.285348] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1912.285559] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1912.285611] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1912.285736] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1912.286678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1912.305098] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1912.305776] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1912.306008] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1912.308178] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.308586] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-706cf80c-4d9b-4030-8bd4-4a190d00e56b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.308790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.308922] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.309279] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.309412] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706cf80c-4d9b-4030-8bd4-4a190d00e56b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1912.464886] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.465764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.465764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.465902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.465902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.466103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.466212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.466275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.466430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.466510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.466722] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 896db215-283f-4c81-b855-943659d9edda already deleted. [ 1912.467130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.492164] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1912.492477] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1912.492477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.641288] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1912.812025] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.812025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.812025] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.812274] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.812374] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.812568] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 706cf80c-4d9b-4030-8bd4-4a190d00e56b not found, creating... [ 1912.812976] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.813273] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.813513] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.814491] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.814491] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.814491] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.814491] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.814696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.814797] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.814942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.815149] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 706cf80c-4d9b-4030-8bd4-4a190d00e56b is going to be created. [ 1912.833840] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1912.834081] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1912.834243] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1912.834529] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1912.834755] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1912.834984] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1913.145095] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [req-ff645bcd-6e4e-45df-a71d-11b563cf91ef req-1d1b22e3-af4a-4297-be32-d73f3637eec7 service nova] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [req-ff645bcd-6e4e-45df-a71d-11b563cf91ef req-1d1b22e3-af4a-4297-be32-d73f3637eec7 service nova] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [req-ff645bcd-6e4e-45df-a71d-11b563cf91ef req-1d1b22e3-af4a-4297-be32-d73f3637eec7 service nova] Enqueued Resource ID: 706cf80c-4d9b-4030-8bd4-4a190d00e56b with Priority: HIGHEST for action port [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_rules [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 1913.518246] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706cf80c-4d9b-4030-8bd4-4a190d00e56b with Priority: HIGHEST for action port [ 1913.519602] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.520073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.521472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.521472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.521472] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1913.522711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.523094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.523274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.524067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.524255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.525017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.525017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.525259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.525471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1913.525786] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1913.529032] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-706cf80c-4d9b-4030-8bd4-4a190d00e56b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.529032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.529032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.529032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.530641] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706cf80c-4d9b-4030-8bd4-4a190d00e56b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1913.533629] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c0dd7db2-180f-41a5-9174-2b80ed059f5f None None] Enqueued Resource ID: 94911da9-7a80-4f47-929c-4fda6a538fd9 with Priority: HIGHEST for action port [ 1913.535026] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94911da9-7a80-4f47-929c-4fda6a538fd9 with Priority: HIGHEST for action port [ 1913.535026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-94911da9-7a80-4f47-929c-4fda6a538fd9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.535026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94911da9-7a80-4f47-929c-4fda6a538fd9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.535026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94911da9-7a80-4f47-929c-4fda6a538fd9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.535887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94911da9-7a80-4f47-929c-4fda6a538fd9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.537147] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94911da9-7a80-4f47-929c-4fda6a538fd9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1913.649117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.649117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.649117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.649117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.651589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1913.651589] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1913.678958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1913.678958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1913.678958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1913.678958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1913.678958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1913.689419] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1914.023838] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.024556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.029987] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1914.033346] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 706cf80c-4d9b-4030-8bd4-4a190d00e56b with status ACTIVE [ 1914.034735] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.034735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.034735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.034735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.034993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.034993] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.035739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.035739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.035739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.035739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.035739] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.035739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.035977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.035977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.036062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.036091] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 706cf80c-4d9b-4030-8bd4-4a190d00e56b is going to be updated. [ 1914.039230] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94911da9-7a80-4f47-929c-4fda6a538fd9 [ 1914.039230] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.039230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.039230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.039230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.039230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.039513] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94911da9-7a80-4f47-929c-4fda6a538fd9 already deleted. [ 1914.040910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94911da9-7a80-4f47-929c-4fda6a538fd9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.057039] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.057122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.057222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.057433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.057516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.057675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-706cf80c-4d9b-4030-8bd4-4a190d00e56b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.254164] env[71051]: INFO networking_nsxv3.common.synchronization [req-92d8336d-8b23-4406-98c0-764f92e49d79 req-2ea63169-71b9-4866-a752-e35c339c4efe tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1914.254886] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1914.255284] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.255421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.255518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.255742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.255907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.256013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.256111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.257512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.257512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.257512] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1914.536389] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1914.546040] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.546040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.546040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.546531] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.546531] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.546680] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.546741] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.546963] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.547348] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.547348] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1914.547498] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1914.547577] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1914.547693] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1914.547811] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1914.547926] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1914.548083] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1914.565512] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1914.565681] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1914.565848] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1914.565997] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.566313] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.566489] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.566617] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.566930] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.567090] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6b2f7-5db2-4611-91e3-3ef73ddd8b28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1914.759608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.759608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1914.759608] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a44db054-67f6-416b-8627-f64892f0cf47 already deleted. [ 1914.759608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.039275] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.039539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.039669] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.039993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.040171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.040329] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 896db215-283f-4c81-b855-943659d9edda is going to be created. [ 1915.065398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.065582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.065657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.065885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.066062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.069737] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.069982] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.070157] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.070439] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.070622] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.070806] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 not found, creating... [ 1915.071119] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.071326] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.071476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.071738] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.071922] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.072377] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.072593] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.072722] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.072954] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.073121] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.073270] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 is going to be created. [ 1915.077498] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 896db215-283f-4c81-b855-943659d9edda in Status: UNINITIALIZED for 2s [ 1915.090817] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.091013] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.091152] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.091403] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.091630] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.091919] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.698782] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1915.699340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.771804] env[71051]: INFO networking_nsxv3.common.synchronization [req-92d8336d-8b23-4406-98c0-764f92e49d79 req-0b9ac548-2003-46fe-ad4a-a64400b92a1e service nova] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1915.772045] env[71051]: INFO networking_nsxv3.common.synchronization [req-92d8336d-8b23-4406-98c0-764f92e49d79 req-0b9ac548-2003-46fe-ad4a-a64400b92a1e service nova] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1915.772216] env[71051]: INFO networking_nsxv3.common.synchronization [req-92d8336d-8b23-4406-98c0-764f92e49d79 req-0b9ac548-2003-46fe-ad4a-a64400b92a1e service nova] Enqueued Resource ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with Priority: HIGHEST for action port [ 1915.772772] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1915.772908] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1915.773016] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with Priority: HIGHEST for action port [ 1915.773655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.773819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.773908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.774153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.774265] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1915.775732] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.777112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.777237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.777441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.777593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.777698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.777766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.777923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.781703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1915.781703] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1915.781703] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1915.781703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1915.781703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1915.781703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1915.781703] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6b2f7-5db2-4611-91e3-3ef73ddd8b28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1916.282876] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1916.283072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1916.283328] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with status ACTIVE [ 1916.283526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1916.283661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1916.283736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1916.283963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1916.284092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1916.284348] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1916.284463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1916.284549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1916.284744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1916.284832] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1916.285056] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1916.285178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1916.285971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1916.285971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1916.285971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1916.285971] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 is going to be updated. [ 1916.287081] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1916.306224] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1916.306374] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1916.306464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1916.306693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1916.306849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1916.307428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1916.789353] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1917.089261] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 896db215-283f-4c81-b855-943659d9edda in Status: SUCCESS [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1917.089261] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1917.089261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1917.089261] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1917.292525] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1917.292778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1917.292778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1917.293021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1917.293116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1917.293323] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be created. [ 1917.318608] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1917.318758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1917.318833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1917.319069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1917.319237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1917.329332] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: UNINITIALIZED for 2s [ 1917.592894] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1918.097719] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 896db215-283f-4c81-b855-943659d9edda: rpc.has_security_group_logging(os_id): False [ 1918.116492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1918.116492] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1918.116492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1918.116492] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 896db215-283f-4c81-b855-943659d9edda is going to be created. [ 1918.171537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1918.172354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1918.172354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1918.172354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1918.172354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1918.181903] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 896db215-283f-4c81-b855-943659d9edda in Status: IN_PROGRESS for 2s [ 1919.339099] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: SUCCESS [ 1919.339438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1919.339487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1919.339682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1919.339870] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1919.339993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1919.340094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1919.340258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1919.340386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1919.340435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1919.340756] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1919.372036] env[71051]: INFO networking_nsxv3.common.synchronization [None req-e41a0d19-91d7-4a78-9efd-44e08ff4d9a2 None None] Enqueued Resource ID: 088e9fee-5e56-418f-aba1-27450f7aebc8 with Priority: HIGHEST for action port [ 1919.372036] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 088e9fee-5e56-418f-aba1-27450f7aebc8 with Priority: HIGHEST for action port [ 1919.372036] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-088e9fee-5e56-418f-aba1-27450f7aebc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1919.372036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-088e9fee-5e56-418f-aba1-27450f7aebc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1919.372036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-088e9fee-5e56-418f-aba1-27450f7aebc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1919.372036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-088e9fee-5e56-418f-aba1-27450f7aebc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1919.372036] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('088e9fee-5e56-418f-aba1-27450f7aebc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1919.845273] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1919.875988] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 088e9fee-5e56-418f-aba1-27450f7aebc8 [ 1919.876571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1919.876571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1919.876571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1919.877036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1919.877036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1919.877036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:088e9fee-5e56-418f-aba1-27450f7aebc8 already deleted. [ 1919.877225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-088e9fee-5e56-418f-aba1-27450f7aebc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.119268] env[71051]: INFO networking_nsxv3.common.synchronization [req-4623ed3c-1022-4b2b-8637-4216bbd0fedc req-8e637014-2942-4b83-8134-4961a0dca387 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1920.119899] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1920.120095] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.120222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.120292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.120488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.120647] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.120740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.120804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.120953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.121061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.121158] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1920.192633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 896db215-283f-4c81-b855-943659d9edda in Status: SUCCESS [ 1920.192908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.348613] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a44db054-67f6-416b-8627-f64892f0cf47: rpc.has_security_group_logging(os_id): False [ 1920.365364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.365541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.365613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.365822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.365925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.366188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.366289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.366353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.366515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.366594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.366681] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be created. [ 1920.433627] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.433627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.433627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.433860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.437018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.445315] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: IN_PROGRESS for 2s [ 1920.624891] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.624891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.624891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.625495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.625495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.625495] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.625859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.625859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.625859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.625957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.625957] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1920.656645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.657115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.657182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.657349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.657486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.676889] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1920.739349] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d90ffe1-83ae-4c8c-826d-d15e5ac32dbb req-6b26ec46-433e-414e-af3b-903a0457db3c tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1920.739965] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1920.740299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.740445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.740518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.740749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.740907] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1920.741016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1920.741438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1920.741717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1920.741890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1920.742187] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1921.075613] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.075613] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.075613] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.075613] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.077228] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.077453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.077664] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.077894] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.078715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.078715] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1921.078715] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1921.078715] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1921.078715] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1921.078942] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1921.078976] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1921.079157] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1921.098427] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1921.098427] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1921.098427] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1921.098427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-969" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.098427] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-9f5ce590-2204-43c8-a983-a41847fd4e3a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.098427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.098427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.098427] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.098427] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5ce590-2204-43c8-a983-a41847fd4e3a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1921.247046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.247658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.247658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.247809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.247916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.248128] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.248231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.248294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.248449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.248529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.248616] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1921.273845] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.273991] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.274076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.274268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.274437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.282898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1921.402779] env[71051]: INFO networking_nsxv3.common.synchronization [None req-747da1be-20d4-4cc5-afb0-a9b4c13cd1ea None None] Enqueued Resource ID: 046e10cb-1362-43f0-acbd-3b42eac8efd0 with Priority: HIGHEST for action port [ 1921.404331] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046e10cb-1362-43f0-acbd-3b42eac8efd0 with Priority: HIGHEST for action port [ 1921.405018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-046e10cb-1362-43f0-acbd-3b42eac8efd0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.407308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-046e10cb-1362-43f0-acbd-3b42eac8efd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.407308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-046e10cb-1362-43f0-acbd-3b42eac8efd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.407496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-046e10cb-1362-43f0-acbd-3b42eac8efd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.407616] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('046e10cb-1362-43f0-acbd-3b42eac8efd0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1921.603168] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.603451] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.603587] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.603895] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.604068] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.604234] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 9f5ce590-2204-43c8-a983-a41847fd4e3a not found, creating... [ 1921.604538] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.604715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.606337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.606337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.606337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.606585] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.606751] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.606876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.607104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.608549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.608549] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 9f5ce590-2204-43c8-a983-a41847fd4e3a is going to be created. [ 1921.627726] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.627955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.628107] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.628452] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.628638] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.628828] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.912783] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 046e10cb-1362-43f0-acbd-3b42eac8efd0 [ 1921.912783] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1921.912905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1921.912938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1921.913196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1921.913290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1921.913389] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:046e10cb-1362-43f0-acbd-3b42eac8efd0 already deleted. [ 1921.913475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-046e10cb-1362-43f0-acbd-3b42eac8efd0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.453493] env[71051]: INFO networking_nsxv3.common.synchronization [req-55c10f7c-8383-4a3b-aaa3-68aaed88715b req-6740f5ca-0a8b-47ab-9491-d057fcbeba2d tempest-DeleteServersTestJSON-1972370673 tempest-DeleteServersTestJSON-1972370673-project-member] Enqueued Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1922.456481] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db with Priority: HIGHEST for action security_group_members [ 1922.459080] env[71051]: INFO networking_nsxv3.common.synchronization [req-77d65522-dfca-4f37-acd5-edc7b1a88739 req-bf7e67c3-a240-4af7-8fef-ad47377d84ef tempest-ServerRescueTestJSON-877836862 tempest-ServerRescueTestJSON-877836862-project-member] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1922.459080] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: SUCCESS [ 1922.459231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.460046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bba870c-b5d9-4661-a3d0-55e05367a8db taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.460239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.461461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.461461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.461881] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bba870c-b5d9-4661-a3d0-55e05367a8db',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1922.462675] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGHEST for action security_group_members [ 1922.468601] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.468845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.468988] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.469279] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.469756] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.469924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.470055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.470322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.470677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.470870] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1922.526695] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d90ffe1-83ae-4c8c-826d-d15e5ac32dbb req-2e7545fc-61a4-4507-97c7-1a01428d6160 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1922.526899] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d90ffe1-83ae-4c8c-826d-d15e5ac32dbb req-2e7545fc-61a4-4507-97c7-1a01428d6160 service nova] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1922.527046] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d90ffe1-83ae-4c8c-826d-d15e5ac32dbb req-2e7545fc-61a4-4507-97c7-1a01428d6160 service nova] Enqueued Resource ID: 9f5ce590-2204-43c8-a983-a41847fd4e3a with Priority: HIGHEST for action port [ 1922.527284] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_rules [ 1922.527412] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1922.527510] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5ce590-2204-43c8-a983-a41847fd4e3a with Priority: HIGHEST for action port [ 1922.528142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.528142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.528257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.528427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.528486] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1922.529303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.529400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.529599] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f5ce590-2204-43c8-a983-a41847fd4e3a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.529705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.529756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.533028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.533028] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5ce590-2204-43c8-a983-a41847fd4e3a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1922.688753] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1922.689472] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 deletion is rescheduled due to dependency. [ 1922.689743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.969038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.969038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.969038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.969469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.969599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.969837] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.969961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.970061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.970207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.970286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.970379] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db is going to be updated. [ 1922.973355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.973498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.973553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.973772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.973772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.973955] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.974066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.974130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.974274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.974423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.974519] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be updated. [ 1922.995881] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.996034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.996104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.996311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.996451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1922.998477] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1922.998593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1922.998661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1922.998827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1922.998942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.006823] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: IN_PROGRESS for 2s [ 1923.007489] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: IN_PROGRESS for 2s [ 1923.032131] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.032290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.034667] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f5ce590-2204-43c8-a983-a41847fd4e3a with status ACTIVE [ 1923.034858] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.034999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.035082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.035264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.035442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.035587] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.035692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.035760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.035948] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.036016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.036738] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.036738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.036738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.036738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.036738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.036738] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f5ce590-2204-43c8-a983-a41847fd4e3a is going to be updated. [ 1923.057291] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.057471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.057549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.057762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.057897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.058072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f5ce590-2204-43c8-a983-a41847fd4e3a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.294038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1923.294241] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1923.294388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.294547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.294783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.294967] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1923.295117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1923.295183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1923.295337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1923.295415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1923.295514] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1923.798441] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1924.301992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1924.804463] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1924.807441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1924.807441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1924.807441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1924.807441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1924.807441] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1924.834021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1924.834021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1924.834021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1924.834021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1924.834021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1924.840986] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1925.017898] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db in Status: SUCCESS [ 1925.018124] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bba870c-b5d9-4661-a3d0-55e05367a8db deletion is rescheduled due to dependency. [ 1925.018241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bba870c-b5d9-4661-a3d0-55e05367a8db" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1925.018965] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 in Status: SUCCESS [ 1925.019133] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 deletion is rescheduled due to dependency. [ 1925.019231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.346778] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a1b31da-3166-46b6-a828-4ffa41414bac req-7ea6e5ec-0190-4301-aa41-f0d90cb31e4f tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1926.347325] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1926.347621] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.347746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.347816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.348382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.348584] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.348695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.348763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.348931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.349038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.349133] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1926.658104] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.658104] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.658104] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.659493] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1926.660035] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1926.661107] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1926.661107] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1926.661107] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1926.661107] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1926.661555] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1926.681692] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1926.681692] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1926.681692] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1926.681692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.681692] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a02af2a6-f927-4477-bf13-ec5c017ea8d3 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.681692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.681692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.681692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.681692] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a02af2a6-f927-4477-bf13-ec5c017ea8d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1926.850518] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1926.851352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.852061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.852431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.852560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.852815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.852951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.853215] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.853556] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.853624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.853803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.853884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.853972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 already deleted. [ 1926.854168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.854722] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.854857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.855102] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1926.855263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1926.855493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1926.855749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1926.855932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.856080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1926.856227] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.185291] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.185291] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.185430] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.185780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.185894] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.186059] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a02af2a6-f927-4477-bf13-ec5c017ea8d3 not found, creating... [ 1927.186404] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.186545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.186773] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.187042] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.187199] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.187519] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.187694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.187820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.188049] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.188196] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.188356] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 is going to be created. [ 1927.209566] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.209566] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.209566] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.209808] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.210012] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.210262] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.358431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.358769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.358769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.358868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.359044] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.359148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.359211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.359365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.359455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.359544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.359689] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.359781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.359842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.359984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.360137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.360229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.360738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.360738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.360738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.360890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.360890] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.863033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7a55e9-4711-4eed-99ed-cbe058c106cc: rpc.has_security_group_logging(os_id): False [ 1927.880497] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.880650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.880711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.881040] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.881168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.881394] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.881500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.881566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.881727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.881805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.881986] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.882094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.882156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.882316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.882406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.882583] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.882680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.882741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.882881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.882956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.883055] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a1b31da-3166-46b6-a828-4ffa41414bac req-27feabb3-872c-4852-8167-c2b0596b17c5 service nova] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a1b31da-3166-46b6-a828-4ffa41414bac req-27feabb3-872c-4852-8167-c2b0596b17c5 service nova] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [req-0a1b31da-3166-46b6-a828-4ffa41414bac req-27feabb3-872c-4852-8167-c2b0596b17c5 service nova] Enqueued Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1927.915020] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1927.915020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.915020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.915020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.915020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.915020] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.916615] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.916779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.916854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.917036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.917188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.917285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.917347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.917498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.917579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.917671] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.919114] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a02af2a6-f927-4477-bf13-ec5c017ea8d3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.919224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.919274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.919424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.919495] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a02af2a6-f927-4477-bf13-ec5c017ea8d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.939827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.939827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1927.939827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1927.940018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1927.940173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1927.954723] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1928.419415] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1928.420498] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.420582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1928.420733] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a02af2a6-f927-4477-bf13-ec5c017ea8d3 with status ACTIVE [ 1928.420893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.421011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1928.421086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1928.421282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1928.421368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1928.421538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.421634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1928.421694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1928.421976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1928.422644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1928.422799] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.423028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1928.423028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1928.423168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1928.423211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1928.423277] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 is going to be updated. [ 1928.443934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.444115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1928.444184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1928.444343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1928.444548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1928.444698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1928.925616] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.427579] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.427910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1929.427910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1929.428078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1929.428249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1929.428295] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be created. [ 1929.457906] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.459380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1929.459380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1929.459380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1929.459380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1929.472235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: UNINITIALIZED for 2s [ 1929.987862] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1929.988151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1930.333252] env[71051]: INFO networking_nsxv3.common.synchronization [req-a6c51626-b064-4bc7-bddd-00834710d595 req-34b619e4-1270-4bf6-b379-a8e639eef8b2 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1930.333252] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1930.333619] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1930.334313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1930.334313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1930.334313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1930.334313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1930.334313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1930.334313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1930.334663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1930.334663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1930.334663] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1930.807035] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1930.807637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1930.807637] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1930.807962] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1930.808502] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1930.808755] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1930.809097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1930.809356] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1930.809608] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1930.809932] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1930.810149] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1930.810510] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1930.810729] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1930.810940] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1930.811152] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1930.811383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1930.830318] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1930.830509] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1930.830782] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1930.830980] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-607" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1930.831323] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-97cc6b99-82a0-4bef-8fff-64787ee8915d taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1930.831511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1930.831642] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1930.831977] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1930.832189] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97cc6b99-82a0-4bef-8fff-64787ee8915d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1930.837034] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1931.340020] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.340020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 97cc6b99-82a0-4bef-8fff-64787ee8915d not found, creating... [ 1931.340020] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.340020] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.341242] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.341242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.341242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.341242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.341242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.341797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 97cc6b99-82a0-4bef-8fff-64787ee8915d is going to be created. [ 1931.343063] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1931.366184] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.367463] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.367770] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.369027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.369027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.369027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.484315] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1931.484607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.485063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.485308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.485617] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.485745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.485855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.485980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.486090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.486177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.486270] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1931.845390] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.845682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.845682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.845828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.845921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.846033] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1931.883676] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.884465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.884465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.884465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.884465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.896026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1931.988950] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.989131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.989203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.989420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.989589] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.989682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.989741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.989880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.991657] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.991657] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.991657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1931.991657] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1932.100988] env[71051]: INFO networking_nsxv3.common.synchronization [req-a6c51626-b064-4bc7-bddd-00834710d595 req-90b62cb3-b1d4-4ee9-80d1-04e0d37b8ffa service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1932.101230] env[71051]: INFO networking_nsxv3.common.synchronization [req-a6c51626-b064-4bc7-bddd-00834710d595 req-90b62cb3-b1d4-4ee9-80d1-04e0d37b8ffa service nova] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1932.101338] env[71051]: INFO networking_nsxv3.common.synchronization [req-a6c51626-b064-4bc7-bddd-00834710d595 req-90b62cb3-b1d4-4ee9-80d1-04e0d37b8ffa service nova] Enqueued Resource ID: 97cc6b99-82a0-4bef-8fff-64787ee8915d with Priority: HIGHEST for action port [ 1932.101851] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_rules [ 1932.101985] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1932.102355] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cc6b99-82a0-4bef-8fff-64787ee8915d with Priority: HIGHEST for action port [ 1932.102661] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.102786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.102853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.103073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.103159] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1932.105072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.105182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.105360] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-97cc6b99-82a0-4bef-8fff-64787ee8915d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.105492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.105563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.105748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.105830] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97cc6b99-82a0-4bef-8fff-64787ee8915d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1932.493417] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 593789cb-4e5f-4320-800f-607a06d60888: rpc.has_security_group_logging(os_id): False [ 1932.510772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.510933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.510989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.511222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.511313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.511502] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.511603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.511668] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.511821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.511900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.512108] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.512199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.512263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.512406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.512632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.512693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.512743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.512890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.512937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.513010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.513109] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be created. [ 1932.566280] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.566422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.566600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.566717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.566872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.579118] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1932.605746] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.605901] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.609731] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97cc6b99-82a0-4bef-8fff-64787ee8915d with status ACTIVE [ 1932.609731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.609731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.609731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.609989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.609989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.610160] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.610257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.610320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.610505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.610590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.610774] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.610869] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.611111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.611111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.611210] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.611259] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97cc6b99-82a0-4bef-8fff-64787ee8915d is going to be updated. [ 1932.636029] env[71051]: INFO networking_nsxv3.common.synchronization [req-5b0c3665-1841-4f1d-8b25-0eed21504017 req-ff818b97-e659-423e-8b32-4002debdc54e tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1932.636149] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1932.636537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.636643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.636643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.636804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.637356] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.637475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.637576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.637809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.637895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.637995] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1932.645677] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1932.645829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1932.645880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1932.646178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1932.646394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1932.646598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97cc6b99-82a0-4bef-8fff-64787ee8915d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.004252] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.004633] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.004633] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.004902] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.005136] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.005299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.005437] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.005669] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.005820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.006176] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1933.006235] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1933.009820] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1933.009820] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1933.009820] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1933.009820] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1933.009820] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1933.025720] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1933.025942] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1933.026064] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1933.026315] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.026605] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-6d193a34-fdde-419e-b264-7798a29965a5 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.026791] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.026915] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.027953] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.027953] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d193a34-fdde-419e-b264-7798a29965a5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1933.141465] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.141709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.141709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.141895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.141984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.142185] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.145420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.145420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.145420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.145420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.145420] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1933.166295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.166420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.166464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.166610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.166741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.182533] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1933.530349] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.530582] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.530640] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.530890] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.532214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.532214] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 6d193a34-fdde-419e-b264-7798a29965a5 not found, creating... [ 1933.532214] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.532214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.532214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.532214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.532214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.536370] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.536370] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.536370] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.536370] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.536370] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.536370] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 6d193a34-fdde-419e-b264-7798a29965a5 is going to be created. [ 1933.551846] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.552064] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.552195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.552448] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.552667] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.552893] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.908459] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1933.908459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.908586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.908780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.909023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1933.909167] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1933.909235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1933.909396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1933.909481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1933.909583] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.415435] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [req-5b0c3665-1841-4f1d-8b25-0eed21504017 req-81384c6b-a7f0-4815-b679-b10acf9a8f8c service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [req-5b0c3665-1841-4f1d-8b25-0eed21504017 req-81384c6b-a7f0-4815-b679-b10acf9a8f8c service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [req-5b0c3665-1841-4f1d-8b25-0eed21504017 req-81384c6b-a7f0-4815-b679-b10acf9a8f8c service nova] Enqueued Resource ID: 6d193a34-fdde-419e-b264-7798a29965a5 with Priority: HIGHEST for action port [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 1934.468301] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193a34-fdde-419e-b264-7798a29965a5 with Priority: HIGHEST for action port [ 1934.469766] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.470083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.471240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.471240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.471240] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.472072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.472879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.473137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d193a34-fdde-419e-b264-7798a29965a5 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.473251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.474131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.474131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.474131] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d193a34-fdde-419e-b264-7798a29965a5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.592748] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1934.593117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1934.721030] env[71051]: INFO networking_nsxv3.common.synchronization [None req-2d0783df-fb2c-42c5-9aa7-a48f85e26f2a None None] Enqueued Resource ID: f4cedaf3-65d8-450c-9c93-feb27942fb4c with Priority: HIGHEST for action port [ 1934.721680] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4cedaf3-65d8-450c-9c93-feb27942fb4c with Priority: HIGHEST for action port [ 1934.722571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4cedaf3-65d8-450c-9c93-feb27942fb4c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.722973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4cedaf3-65d8-450c-9c93-feb27942fb4c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.722973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4cedaf3-65d8-450c-9c93-feb27942fb4c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.725252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4cedaf3-65d8-450c-9c93-feb27942fb4c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.725252] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cedaf3-65d8-450c-9c93-feb27942fb4c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.919191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1934.976131] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.976359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.976660] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d193a34-fdde-419e-b264-7798a29965a5 with status ACTIVE [ 1934.976709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.976824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.977645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.977645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.977645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1934.977645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.977645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.977645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.978185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.978185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1934.978185] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.978386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.978441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.978568] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.978647] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1934.978748] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d193a34-fdde-419e-b264-7798a29965a5 is going to be updated. [ 1934.998522] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1934.998763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1934.998763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1934.998923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1934.999165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1934.999258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.195138] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1935.196050] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 deletion is rescheduled due to dependency. [ 1935.196050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.196050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1935.196050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1935.196050] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1935.196328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1935.196328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1935.196474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1935.196546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.196644] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1935.226951] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4cedaf3-65d8-450c-9c93-feb27942fb4c [ 1935.227151] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1935.227350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1935.227437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1935.227656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1935.227752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.227850] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4cedaf3-65d8-450c-9c93-feb27942fb4c already deleted. [ 1935.227936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4cedaf3-65d8-450c-9c93-feb27942fb4c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.425868] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1935.425868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1935.425868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1935.425868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1935.425868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.425868] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1935.451711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1935.453182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1935.456020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1935.456020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1935.456020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1935.463400] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1935.699486] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1936.201999] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1936.685384] env[71051]: INFO networking_nsxv3.common.synchronization [None req-a85ff4f9-8873-4040-a35b-69ab6cb237a1 None None] Enqueued Resource ID: 0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc with Priority: HIGHEST for action port [ 1936.686269] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc with Priority: HIGHEST for action port [ 1936.687196] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.687330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.687399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.687686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.687768] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1936.704249] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.704418] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.704486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.705661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.705661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1936.705661] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1936.736070] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.736228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.736310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.736514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.736658] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1936.744919] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1937.099307] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.099307] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.099307] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.099307] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.099307] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.102844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.102844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.102844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.102844] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.102844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.102844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.103295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.103295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.103295] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.105515] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.105515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.105515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.105515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.106171] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.106171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.106171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.106171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.106171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.106171] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.122295] env[71051]: INFO networking_nsxv3.common.synchronization [req-aecc0f58-3b69-4dc9-aef0-e91299db5a71 req-a752cb99-cf3a-4b5b-92cf-fdfe8008c208 tempest-ServerDiskConfigTestJSON-1394011369 tempest-ServerDiskConfigTestJSON-1394011369-project-member] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1937.123445] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGHEST for action security_group_members [ 1937.124514] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.124706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.124810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.125200] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.125405] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.125547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.125638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.125831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.125950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.126086] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.163563] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_rules [ 1937.163780] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.163931] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1937.164153] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.164252] env[71051]: INFO networking_nsxv3.common.synchronization [req-2958373c-fb21-4a01-99f9-1c5f9eae2aba req-b6269a07-1c1c-4529-be13-168b92cc5927 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1937.164996] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_rules [ 1937.165182] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1937.165251] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1937.165344] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.165473] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.165807] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.165935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.166011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.166471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.166563] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.167412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.167534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.167609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.167781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.167857] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.168592] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a02af2a6-f927-4477-bf13-ec5c017ea8d3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.168702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.168768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.168920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.168993] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a02af2a6-f927-4477-bf13-ec5c017ea8d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.169668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.169763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.170145] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.170257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.190286] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc [ 1937.190504] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.190785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.190785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.190905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.190993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.191104] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc already deleted. [ 1937.191187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f7e9e16-bb1c-47d6-9e22-f689c6f7cccc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.455729] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.455905] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1937.456172] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.456746] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.456899] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1937.456999] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.457327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.457437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.457690] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.457816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.457884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.458177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.458344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.458470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.458557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.458737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.458826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.458931] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.459869] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.459990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.474023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.474023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.474023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.474460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.474460] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.513233] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_rules [ 1937.513459] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.513716] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1937.513986] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.514174] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_rules [ 1937.514330] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1937.514532] env[71051]: INFO networking_nsxv3.common.synchronization [req-505cfae2-b1b0-40a4-aed6-c3b43f37de78 req-66704ab9-395c-471a-b1a4-70c764bf2360 tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1937.515204] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_rules [ 1937.515367] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1937.515488] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1937.515686] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 with Priority: HIGHEST for action port [ 1937.515868] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_rules [ 1937.515978] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1937.516092] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1937.516398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.516526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.516741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.517731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.517731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.517731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.517731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a02af2a6-f927-4477-bf13-ec5c017ea8d3 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.517731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.517963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.517963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.517963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.518227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.518312] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.519401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.519572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.519798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.519886] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.609141] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.609475] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.628491] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.628616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.628716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.629338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.629338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.629338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.629338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.629338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.629678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.629678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.629678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be updated. [ 1937.665414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.665607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.665644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.665838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.665976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.671544] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.671657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.673767] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: IN_PROGRESS for 2s [ 1937.673938] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a02af2a6-f927-4477-bf13-ec5c017ea8d3 with status ACTIVE [ 1937.674660] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.674660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.674660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.674660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.674660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.674882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.674882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.674950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.675080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.675138] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.675318] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.675411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.675476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.675859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.675859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.675859] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 is going to be updated. [ 1937.676711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.676803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.695652] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.695949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.695949] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.696178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.696317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.696477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.698388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.698388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.698388] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a02af2a6-f927-4477-bf13-ec5c017ea8d3',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.963265] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.978178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.978178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.978178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.978178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.978769] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.979354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.979354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.979354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.979354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.979354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.979576] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1938.021028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.021219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.111958] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1938.113011] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1938.200896] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a02af2a6-f927-4477-bf13-ec5c017ea8d3 with status ACTIVE [ 1938.201236] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.201455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.201546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.201911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.201911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.202055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.202169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.202229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.202383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.202481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.202631] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.202725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.202787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.202929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.203017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.203096] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a02af2a6-f927-4477-bf13-ec5c017ea8d3 is going to be updated. [ 1938.226525] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.226525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.226726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.226976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.227161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.227984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a02af2a6-f927-4477-bf13-ec5c017ea8d3" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.466385] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1938.483100] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d06bf6c-ef7f-42d0-911f-d260f48bffe2: rpc.has_security_group_logging(os_id): False [ 1938.500044] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.500044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.500044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.500044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.500044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.500044] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.500044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.500499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.500499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.500499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.500585] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.500652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.500700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.500857] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.500935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.501129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.501236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.501289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.501482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.501578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.501660] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1938.599648] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.599851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.599971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.600363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.600363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.615273] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.615522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.615522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.615760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.615854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.615980] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1938.617446] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.617650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.617650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.617799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.617884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.618312] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be created. [ 1938.619815] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1938.658286] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.658286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.658286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.658286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.658286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.665295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.665441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.665529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.665745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.665882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.698642] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1938.700271] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: UNINITIALIZED for 2s [ 1938.762067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1938.763058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.763058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.763219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.763405] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.763535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.763606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.763771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.763855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.763940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.764068] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1938.968297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.968481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.968535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.968817] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.968919] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1938.969040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 is going to be created. [ 1938.991651] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1938.991887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1938.991887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1938.992080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1938.992238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1939.002227] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: UNINITIALIZED for 2s [ 1939.266534] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1939.684638] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc in Status: SUCCESS [ 1939.685041] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc deletion is rescheduled due to dependency. [ 1939.685251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1939.769037] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 1939.785614] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1939.785787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1939.785867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1939.786101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1939.786198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1939.786470] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1939.786581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1939.786652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1939.786826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1939.786913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1939.787017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 1939.841933] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1939.842078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1939.842139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1939.842439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1939.842887] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1939.856525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 1940.634395] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1940.634395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1940.723038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1940.723038] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1940.723038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1940.723038] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1940.725265] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1940.728531] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1940.728531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1940.728531] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.013030] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: SUCCESS [ 1941.013030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.013333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.013365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.013668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.013881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.013881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.014112] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.014238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.014382] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.228853] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.229900] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.517663] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.732066] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.735130] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.870619] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 1941.870921] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.020397] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.116399] env[71051]: INFO networking_nsxv3.common.synchronization [req-c2b82220-fe35-4de2-854b-3eef2252d024 req-34c415dc-cde7-4630-b01d-3886e9a8b4e5 tempest-ServerGroupTestJSON-1538933740 tempest-ServerGroupTestJSON-1538933740-project-member] Enqueued Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1942.116677] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1942.116983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.117126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.117194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.117430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.118103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.118103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.118103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.118103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.118103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.118103] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.235303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.235502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.235570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.235796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.235889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.235990] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1942.237344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.237486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.237565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.238223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.238223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.238223] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be updated. [ 1942.268786] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.268931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.268975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.269211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.269357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.271224] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.271224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.271224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.271427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.271427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.284183] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1942.284865] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1942.423698] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.423959] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.424543] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.424941] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.425270] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.425448] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.425611] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.425866] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.426034] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.426263] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1942.426386] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1942.426504] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1942.426621] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1942.426739] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1942.426875] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1942.427026] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1942.445207] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1942.445414] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1942.445583] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1942.445791] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-399" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.446178] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-430f8da5-bceb-4244-9e58-bcd30a1dab57 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.446407] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.446576] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.446956] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.447138] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('430f8da5-bceb-4244-9e58-bcd30a1dab57',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.523089] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.523219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.523291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.523490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.523584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.523687] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 is going to be updated. [ 1942.548738] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.548829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.548907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.549148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.549290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.557461] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: IN_PROGRESS for 2s [ 1942.619983] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.620172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.620245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.620460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.620557] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.620807] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.621184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.621184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.621184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.621321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.621321] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 already deleted. [ 1942.621401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.949440] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.949695] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.949851] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.950183] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.950381] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.950558] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 430f8da5-bceb-4244-9e58-bcd30a1dab57 not found, creating... [ 1942.950829] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.951040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.951201] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.951447] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.951632] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.951965] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.952179] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.952339] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.952597] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.952920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.952992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 430f8da5-bceb-4244-9e58-bcd30a1dab57 is going to be created. [ 1942.971845] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.972078] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.972208] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.972514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.972745] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.972977] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.682856] env[71051]: INFO networking_nsxv3.common.synchronization [req-c2b82220-fe35-4de2-854b-3eef2252d024 req-3a5c29f9-b6eb-4776-be11-daa08f10e22e service nova] Enqueued Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_rules [ 1943.683176] env[71051]: INFO networking_nsxv3.common.synchronization [req-c2b82220-fe35-4de2-854b-3eef2252d024 req-3a5c29f9-b6eb-4776-be11-daa08f10e22e service nova] Enqueued Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1943.683279] env[71051]: INFO networking_nsxv3.common.synchronization [req-c2b82220-fe35-4de2-854b-3eef2252d024 req-3a5c29f9-b6eb-4776-be11-daa08f10e22e service nova] Enqueued Resource ID: 430f8da5-bceb-4244-9e58-bcd30a1dab57 with Priority: HIGHEST for action port [ 1943.683800] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_rules [ 1943.683964] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1943.684031] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 430f8da5-bceb-4244-9e58-bcd30a1dab57 with Priority: HIGHEST for action port [ 1943.684308] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.684436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.684566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.685676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.685676] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1943.687218] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.687345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.687406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.687575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.687728] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.687824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.687888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.688034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.688178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.688236] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1943.691298] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-430f8da5-bceb-4244-9e58-bcd30a1dab57 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.691416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.691477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.691629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.691706] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('430f8da5-bceb-4244-9e58-bcd30a1dab57',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.188333] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.188500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.193812] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.194601] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 430f8da5-bceb-4244-9e58-bcd30a1dab57 with status ACTIVE [ 1944.194777] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.194953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.194953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.195157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.195245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.195430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.195562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.195642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.195779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.195859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.196054] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.196158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.196213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.196337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.196411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.196492] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 430f8da5-bceb-4244-9e58-bcd30a1dab57 is going to be updated. [ 1944.216838] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.217083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.217083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.217237] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.217371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.217522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-430f8da5-bceb-4244-9e58-bcd30a1dab57" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.295986] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1944.296239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.296347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.296565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.296754] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.296871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.296929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.297101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.297182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.297277] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.301634] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1944.301634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.301766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.301881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.302029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.302152] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.302208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.302328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.302486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.302584] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.571906] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: SUCCESS [ 1944.572311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.572311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.572951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.574191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.574191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.574191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.574191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.574191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.574191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.574191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.702470] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.799435] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.805278] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1945.076030] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1945.204011] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.204262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.204262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.205032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.205032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.205032] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 is going to be created. [ 1945.228815] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.228815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.228815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.228815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.228815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.238224] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: UNINITIALIZED for 2s [ 1945.302228] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1945.310999] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1945.459441] env[71051]: INFO networking_nsxv3.common.synchronization [req-fca883a4-e2ed-4cf3-b14c-f7af039cb241 req-41e82a30-353d-4b62-9bf1-796c6b002f6a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1945.459441] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1945.459441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.459441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.577813] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d44ee8ef-f57d-42d4-b308-e057c9153016: rpc.has_security_group_logging(os_id): False [ 1945.596901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.597263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.597376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.597643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.597899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.598159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.598269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.598336] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.598500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.598585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.598676] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 is going to be created. [ 1945.657031] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.657202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.657275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.657483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.657653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.670520] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: IN_PROGRESS for 2s [ 1945.689106] env[71051]: INFO networking_nsxv3.common.synchronization [req-d9340139-91b6-4c1a-8c1b-f0ff4cba551c req-678312aa-2f2e-482f-b1ac-69474a55d6c2 tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1945.689629] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1945.690066] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.690275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.690743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.691099] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.691396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.691575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.691679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.691925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.692106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.692430] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1945.806998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.806998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.806998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.806998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.806998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.806998] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1945.815307] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.815307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.815307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.815307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.815307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.815307] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be updated. [ 1945.841433] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.841433] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.841433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.842251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.842654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.859972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1945.859972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1945.882285] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.882285] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.882285] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.882873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.883185] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.883506] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.883766] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.883929] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.884097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.884314] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1945.884435] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1945.884602] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1945.884720] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1945.884949] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1945.884949] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1945.885108] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1945.905154] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1945.905350] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1945.905524] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1945.905700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-201" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1945.905995] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-f4acf235-bcc5-47b2-ad12-244062b3575a taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1945.906183] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1945.906310] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1945.906620] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1945.906846] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4acf235-bcc5-47b2-ad12-244062b3575a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1946.194610] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1946.408752] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.409089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1946.409278] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.409561] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.409719] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.409884] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port f4acf235-bcc5-47b2-ad12-244062b3575a not found, creating... [ 1946.410166] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.410343] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1946.410470] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.410696] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.410842] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.411218] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.411398] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1946.411541] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.411766] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.411908] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.412073] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: f4acf235-bcc5-47b2-ad12-244062b3575a is going to be created. [ 1946.438704] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.438704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1946.438704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.438704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.438704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.438704] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.697434] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.133778] env[71051]: INFO networking_nsxv3.common.synchronization [req-fca883a4-e2ed-4cf3-b14c-f7af039cb241 req-c056aab2-c1f5-45c8-94d9-79453c436262 service nova] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1947.134017] env[71051]: INFO networking_nsxv3.common.synchronization [req-fca883a4-e2ed-4cf3-b14c-f7af039cb241 req-c056aab2-c1f5-45c8-94d9-79453c436262 service nova] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1947.134176] env[71051]: INFO networking_nsxv3.common.synchronization [req-fca883a4-e2ed-4cf3-b14c-f7af039cb241 req-c056aab2-c1f5-45c8-94d9-79453c436262 service nova] Enqueued Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1947.134762] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1947.134832] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1947.134932] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1947.135300] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.135406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.135623] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.135717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.135908] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4acf235-bcc5-47b2-ad12-244062b3575a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.136016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.136083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.136281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.136361] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4acf235-bcc5-47b2-ad12-244062b3575a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.199825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.200044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.200044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.200254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.200350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.200446] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1947.230118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.230118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.230118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.230118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.230118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.241069] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1947.245910] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: SUCCESS [ 1947.246137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.246289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.246483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.246655] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.246762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.246827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.246973] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.247067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.247154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.247245] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.638226] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4acf235-bcc5-47b2-ad12-244062b3575a with status ACTIVE [ 1947.639377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.639545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.639616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.639834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.639929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.640142] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.640251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.640344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.640470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.640545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.640742] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.640838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.640900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.641055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.641132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.641218] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4acf235-bcc5-47b2-ad12-244062b3575a is going to be updated. [ 1947.680614] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.680782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.680827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.681188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.681188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.681315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.684425] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: SUCCESS [ 1947.684652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.748876] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.749085] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.749141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.749356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.749526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.749727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.749727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.749831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.749937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.750038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.750137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.750233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.750289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.750428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.750564] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.750654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.751073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.751073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.751073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.751073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.751233] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.871191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1947.871466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.871627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.871847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.872047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.872170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.872233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.872455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.872582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.873738] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.874291] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.875343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.875343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.875693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.875693] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.253678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81: rpc.has_security_group_logging(os_id): False [ 1948.270898] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.270898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1948.270898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1948.270898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1948.270898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1948.271178] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.271178] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1948.271282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1948.271375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1948.271449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1948.271643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.271751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1948.271831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1948.272053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1948.272128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1948.272304] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.272392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1948.272450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1948.272586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1948.272656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1948.272738] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 is going to be created. [ 1948.327634] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.327634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1948.327634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1948.327842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1948.327959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1948.338059] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: IN_PROGRESS for 2s [ 1948.378344] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.379384] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.882278] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.883252] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1949.250567] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1949.250884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1949.385326] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.385734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1949.385734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1949.386012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1949.386198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1949.386345] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be updated. [ 1949.388061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.388216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1949.388313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1949.388541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1949.388666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1949.388794] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1949.445308] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.445459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1949.445559] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1949.445742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1949.445897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1949.448027] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.448027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1949.448027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1949.448213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1949.448213] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1949.460815] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1949.461451] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1950.351233] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: SUCCESS [ 1950.351461] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.471961] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1951.472421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.472474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.472706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.472930] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.473113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1951.473212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.473426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.473528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.473636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.473753] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.475477] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1951.475713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.475912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.476141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.476377] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.476510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1951.476581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.476745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.477027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.477027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.477098] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.478276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.478484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.478687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.478805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1951.478876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1951.479068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1951.479186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1951.479288] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.979191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.981055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.981055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1951.981263] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1952.136014] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1952.136769] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 1952.185490] env[71051]: INFO networking_nsxv3.common.synchronization [req-66eea42c-3e5c-45d2-9d61-bfc57b27d5bc req-816c8c7b-ec57-483c-8742-ac3e00cfe73b tempest-ServersTestJSON-1164544532 tempest-ServersTestJSON-1164544532-project-member] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1952.186040] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGHEST for action security_group_members [ 1952.186343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.186466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.186534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.186729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.186875] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.186984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.187033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.187375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.187375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.187375] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1952.481084] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d: rpc.has_security_group_logging(os_id): False [ 1952.482589] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1952.499681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.499833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.499899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.500143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.500223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.500461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.500561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.500628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.500781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.500855] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.500943] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be created. [ 1952.556759] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.556759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.556759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.557038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.557240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.569230] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1952.689538] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.689766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.689912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.690216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.690371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.690646] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.690821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.690903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.691157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.691273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.691423] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be updated. [ 1952.726371] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.726624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.726624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.726858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.726997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.735758] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: IN_PROGRESS for 2s [ 1952.986047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.986047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1952.986047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1952.986047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1952.986047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.986363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1953.016019] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1953.016207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1953.016276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1953.016448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1953.016608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1953.024436] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1953.612745] env[71051]: INFO networking_nsxv3.common.synchronization [req-e0e0d340-3d53-4076-908c-0c0dcaba346a req-b9111403-2708-43b0-a99a-8d738b904ddb tempest-ServerGroupTestJSON-1538933740 tempest-ServerGroupTestJSON-1538933740-project-member] Enqueued Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1953.613326] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGHEST for action security_group_members [ 1953.613652] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1953.613785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1953.613854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1953.614212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1953.614383] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1953.614487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1953.614580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1953.614771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1953.614845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1953.615205] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1954.117051] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.117236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.117283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.117495] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.117590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.117808] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.117908] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.117975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.118179] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.118262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.118353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 is going to be updated. [ 1954.140021] env[71051]: INFO networking_nsxv3.common.synchronization [None req-6315afa6-3530-45f4-b2f3-f05a4c94b2ab tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1954.140606] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1954.140880] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.141010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.141132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.141332] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.141416] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1954.145716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.145977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.146118] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.146260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.146399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.154451] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: IN_PROGRESS for 2s [ 1954.220725] env[71051]: INFO networking_nsxv3.common.synchronization [None req-9e44d1fc-3a95-4323-af65-2aa940e90608 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1954.221329] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1954.221713] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.221820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.582908] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1954.583302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.583510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.583816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.583956] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1954.660958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1954.660958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1954.661292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.661292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.661356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.661435] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae already deleted. [ 1954.661529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1954.662274] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1954.662380] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1954.662482] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1954.747074] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 in Status: SUCCESS [ 1954.747231] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 deletion is rescheduled due to dependency. [ 1954.747341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.034565] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1955.035081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.035081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.035216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.035412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.035558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.035676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.035751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.035891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.035989] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.087712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.087712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.087883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.089683] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.089683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.089683] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.266013] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.266158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.266230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.266433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.266522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.266670] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae already deleted. [ 1955.266772] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.538238] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.591864] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.629373] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1955.629558] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1955.630055] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1955.630230] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1955.630509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.630613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.630974] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.630974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.630974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.631342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.631500] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.631764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.631764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.631881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.631911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1955.631992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.685744] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1955.685999] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1955.685999] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_rules [ 1955.686410] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1955.686410] env[71051]: INFO networking_nsxv3.common.synchronization [req-141aec46-d36f-4559-93e7-d8cd808199a7 req-30e7b284-684a-4349-8467-d5603a6c84fd tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1955.688097] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1955.688156] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_rules [ 1955.688288] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1955.688338] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1955.688422] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1955.692100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.692100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.692100] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.692100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4acf235-bcc5-47b2-ad12-244062b3575a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1955.692100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1955.692100] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4acf235-bcc5-47b2-ad12-244062b3575a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1955.693654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.693739] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1955.694053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1955.694137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.041191] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1956.093825] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d: rpc.has_security_group_logging(os_id): False [ 1956.110414] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.110590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.110590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.110789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.110888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.111147] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.111252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.111319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.111477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.111555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.111643] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be updated. [ 1956.134622] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1956.163637] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.163811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.163905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.164158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.164329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.165974] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 in Status: SUCCESS [ 1956.166177] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 deletion is rescheduled due to dependency. [ 1956.166305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.175451] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1956.192419] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.192615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.193862] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4acf235-bcc5-47b2-ad12-244062b3575a with status ACTIVE [ 1956.194070] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.194189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.194271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.194591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.194721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.194904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.195015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.195087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.195247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.195329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.195509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.195755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.195836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.196012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.196115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.196209] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4acf235-bcc5-47b2-ad12-244062b3575a is going to be updated. [ 1956.239839] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.239839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.239839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.239839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.240256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.240256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.543904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.544258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.544258] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.544507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.544648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.544763] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1956.595101] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1956.595255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1956.595326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1956.595538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1956.595724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1956.604013] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1956.636559] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1957.060488] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.060796] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.060923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.061271] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.061583] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.061782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.061923] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.062206] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.062385] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.062652] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1957.062805] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1957.062946] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1957.063090] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1957.063242] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1957.063367] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1957.063540] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1957.081884] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1957.082073] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1957.082260] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1957.082384] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-781" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.082695] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-55633c87-2423-4570-bbb2-7c73a6ddf16f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.082871] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.083218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.083297] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.083412] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55633c87-2423-4570-bbb2-7c73a6ddf16f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1957.138857] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.139030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.139100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.139295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.139385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.139483] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be created. [ 1957.162978] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.163129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.163129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.163322] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.163478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.171788] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: UNINITIALIZED for 2s [ 1957.590074] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.590074] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.590074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.590605] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.590605] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.590605] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.590605] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.590605] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.590605] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f is going to be updated. [ 1957.615346] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1957.615873] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1957.616145] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1957.616536] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1957.616910] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1957.617272] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.189045] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1958.189304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.282821] env[71051]: INFO networking_nsxv3.common.synchronization [req-7e26f646-9f4e-4a07-a0c8-944b36fb809c req-84a64dee-cca6-473a-84e1-53c129078a39 service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1958.283049] env[71051]: INFO networking_nsxv3.common.synchronization [req-7e26f646-9f4e-4a07-a0c8-944b36fb809c req-84a64dee-cca6-473a-84e1-53c129078a39 service nova] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1958.283201] env[71051]: INFO networking_nsxv3.common.synchronization [req-7e26f646-9f4e-4a07-a0c8-944b36fb809c req-84a64dee-cca6-473a-84e1-53c129078a39 service nova] Enqueued Resource ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f with Priority: HIGHEST for action port [ 1958.283719] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_rules [ 1958.283857] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1958.283955] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f with Priority: HIGHEST for action port [ 1958.284239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.284364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.284448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.284683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.284780] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.285627] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.285789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.285864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.286039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.286188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.286282] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.287036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.287036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.287036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.287036] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.287337] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-55633c87-2423-4570-bbb2-7c73a6ddf16f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.287431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.287492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.287640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.287714] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55633c87-2423-4570-bbb2-7c73a6ddf16f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.637041] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1958.637253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.637546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.637809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.638053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.638190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.638243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.638395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.638480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.638563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.638719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.638798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.638859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.638995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.639154] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.639241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.639289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.639432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.639505] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.639583] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.639682] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.640533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.641156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.641156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.641156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.641156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.641156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.641378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.641378] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.789856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.790063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.790225] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1958.791244] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55633c87-2423-4570-bbb2-7c73a6ddf16f with status ACTIVE [ 1958.791363] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.791480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.791546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.792144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.792144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.792144] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.792144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.792367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.792367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.792367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.792613] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.792743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.792805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.792953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.793075] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.793120] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55633c87-2423-4570-bbb2-7c73a6ddf16f is going to be updated. [ 1958.815103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1958.815103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1958.815325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1958.815401] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1958.815522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1958.815822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55633c87-2423-4570-bbb2-7c73a6ddf16f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.143041] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 593789cb-4e5f-4320-800f-607a06d60888: rpc.has_security_group_logging(os_id): False [ 1959.144123] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1959.161073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.161224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.161296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.161507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.161599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.161798] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.161897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.161961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.162143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.162240] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.162436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.162533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.162596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.162737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.162813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.163030] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.163168] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.163226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.163371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.163446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.163536] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1959.179385] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: SUCCESS [ 1959.179616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.179870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.180147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.180328] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.180437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.180511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.180718] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.180801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.180895] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1959.218100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.218421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.218421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.218767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.218767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.230672] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1959.294848] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1959.646180] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1959.684801] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1959.797079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.797280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.797350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.797530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.797625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.797731] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1959.823179] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1959.823363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1959.823363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1959.823574] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1959.823716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1959.832297] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1960.148076] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1960.148252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1960.148510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1960.148581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1960.148617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1960.148748] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1960.174466] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1960.174690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1960.174789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1960.175020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1960.175437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1960.182940] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1960.186644] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1960.692254] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1960.693191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1960.693191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1960.693191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1960.693191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1960.693191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be updated. [ 1960.719374] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1960.719532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1960.719604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1960.719814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1960.719958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1960.727866] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: IN_PROGRESS for 2s [ 1961.244230] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1961.244470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1961.244688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1961.244935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1961.245043] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1961.748059] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1961.748830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1961.843128] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1961.843369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1961.843564] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1961.843816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1961.844015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1961.844154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1961.844222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1961.844386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1961.844489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1961.844635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1961.844724] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1962.112770] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1962.114151] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.114317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.116007] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.116122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.116379] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.116542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.116542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.116752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.116905] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.117048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.117196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.117311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.117382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.117469] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.192593] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1962.192771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.192938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.193216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.193436] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.193551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.193610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.193806] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.193868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.193981] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.238032] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_rules [ 1962.238237] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1962.238399] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1962.238576] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1962.238750] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_rules [ 1962.238898] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1962.239159] env[71051]: INFO networking_nsxv3.common.synchronization [req-703e2792-11b4-43af-bfee-bd35befbb3e0 req-a5dd2902-2dfb-401a-8878-674b7e4a5d4a tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1962.239644] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_rules [ 1962.239820] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_rules [ 1962.240097] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1962.240237] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4acf235-bcc5-47b2-ad12-244062b3575a with Priority: HIGHEST for action port [ 1962.240337] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_rules [ 1962.240428] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1962.240512] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1962.240829] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a396f9-0f7f-4c4e-9eb4-a65e45105c56 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.240974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.241057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.241312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.241395] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.242327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.242444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.243705] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.243705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.243705] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4acf235-bcc5-47b2-ad12-244062b3575a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.243705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.243705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.243705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.243705] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4acf235-bcc5-47b2-ad12-244062b3575a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.244584] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.244725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.245008] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.245090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.245298] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.245381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.349689] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.350458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.350642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.350891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.351103] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.351226] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.351292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.351442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.351530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.351620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.351801] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.351913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.351983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.352141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.352277] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.352529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.352529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.352716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.352716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.352807] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.352851] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.624230] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.700646] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.737205] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: SUCCESS [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.739172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.739172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.739172] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.740074] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.740228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.740416] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.740536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.740635] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.740864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.741106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.741170] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1962.746118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.746272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.747529] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4acf235-bcc5-47b2-ad12-244062b3575a with status ACTIVE [ 1962.747980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.747980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.747980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.749243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.749243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.749243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.749704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.749704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.749704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.749704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.749903] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4acf235-bcc5-47b2-ad12-244062b3575a is going to be updated. [ 1962.781146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.781352] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.781474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.781799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.781943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.782177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4acf235-bcc5-47b2-ad12-244062b3575a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.855159] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 371c9558-8dd8-4739-882d-f7fbf1f26c54: rpc.has_security_group_logging(os_id): False [ 1962.873668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.873889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.874026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.874269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.874524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.874899] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.874899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.874899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.875076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.875076] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.875249] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.875358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.875455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.875646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.875736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.876037] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.876155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.876221] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.876369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.876448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.876538] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1962.955323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.955472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1962.955543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1962.955776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1962.955954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1962.970722] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1963.127389] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.203051] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.243423] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.244311] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.631285] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.631553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.631553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.632201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.632201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.632201] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 is going to be created. [ 1963.662903] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.663047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.663137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.664638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.664638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.674155] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 in Status: UNINITIALIZED for 2s [ 1963.677255] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ec16ac9-d731-43c2-85c8-d7f8fb5ffd10 req-e5caab19-77f8-4a86-9396-c61b4752930f tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 1963.677791] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 1963.678104] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.678224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.678288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.678548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.678698] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.678795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.678854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.679026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.680396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.680396] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.705412] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.707046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.707046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.707046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.707046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.707046] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1963.731507] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.731709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.731799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.731936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.732104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.742833] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1963.746580] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63d494f1-2f72-4fc0-bede-2bafb6275891: rpc.has_security_group_logging(os_id): False [ 1963.748653] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1963.768431] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.768830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.768830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.769192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.769339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.769738] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.769882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.770013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.770369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.770719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.770856] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be created. [ 1963.835547] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1963.835547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1963.835547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1963.835777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1963.836345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1963.854496] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: IN_PROGRESS for 2s [ 1964.186994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.186994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.186994] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae already deleted. [ 1964.186994] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.224338] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.224705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.224705] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.225227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.225624] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.226560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.226560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.226560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.226758] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.227061] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1964.227173] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1964.227286] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1964.227398] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1964.228126] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1964.228126] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1964.228126] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1964.248692] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1964.248692] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1964.248692] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1964.248692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.249057] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-fe09ca58-49c5-43fb-bcf0-c9b632175131 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.249057] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.249159] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.252247] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.252247] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe09ca58-49c5-43fb-bcf0-c9b632175131',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.252247] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.252247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.252247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.252247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.252247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.252247] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be updated. [ 1964.279911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.280115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.280161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.280370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.280547] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.290871] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: IN_PROGRESS for 2s [ 1964.757519] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.757519] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port fe09ca58-49c5-43fb-bcf0-c9b632175131 not found, creating... [ 1964.757519] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.757519] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.758099] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.758099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.758099] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.759225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.759564] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.759897] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: fe09ca58-49c5-43fb-bcf0-c9b632175131 is going to be created. [ 1964.781333] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.781761] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.781761] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.781993] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.782314] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.782464] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1964.790407] env[71051]: INFO networking_nsxv3.common.synchronization [None req-1bc091a2-f9ef-4c3c-910f-e7f112745881 None None] Enqueued Resource ID: 2c4672bb-17df-4d7f-83ae-fd3f176945a0 with Priority: HIGHEST for action port [ 1964.791022] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c4672bb-17df-4d7f-83ae-fd3f176945a0 with Priority: HIGHEST for action port [ 1964.791355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c4672bb-17df-4d7f-83ae-fd3f176945a0 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.791501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c4672bb-17df-4d7f-83ae-fd3f176945a0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1964.791558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c4672bb-17df-4d7f-83ae-fd3f176945a0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1964.791842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c4672bb-17df-4d7f-83ae-fd3f176945a0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1964.791956] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4672bb-17df-4d7f-83ae-fd3f176945a0',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.986887] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1964.987166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.005500] env[71051]: INFO networking_nsxv3.common.synchronization [req-47b6d1ea-eaa2-4e17-a5e6-947d4c4aca8c req-4b19651f-7edc-4867-89da-c0e04ad8f71e tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1965.005500] env[71051]: INFO networking_nsxv3.common.synchronization [req-47b6d1ea-eaa2-4e17-a5e6-947d4c4aca8c req-4b19651f-7edc-4867-89da-c0e04ad8f71e tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1965.005824] env[71051]: INFO networking_nsxv3.common.synchronization [req-47b6d1ea-eaa2-4e17-a5e6-947d4c4aca8c req-4b19651f-7edc-4867-89da-c0e04ad8f71e tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1965.009345] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1965.009345] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 with Priority: HIGHEST for action security_group_members [ 1965.009345] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 with Priority: HIGHEST for action security_group_members [ 1965.009345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.009345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.009345] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.009345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.009683] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-63d494f1-2f72-4fc0-bede-2bafb6275891 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.009683] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.155030] env[71051]: INFO networking_nsxv3.common.synchronization [None req-705fda75-93f9-40e3-bb80-057fc18ed161 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1965.155030] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1965.155395] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.155395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.155395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.155625] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.155715] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.268082] env[71051]: INFO networking_nsxv3.common.synchronization [None req-673e41d2-06ab-418b-9894-475268bb8053 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1965.268082] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1965.268082] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.268082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.297901] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c4672bb-17df-4d7f-83ae-fd3f176945a0 [ 1965.297901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.298153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.298153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.299366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.299366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.299366] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c4672bb-17df-4d7f-83ae-fd3f176945a0 already deleted. [ 1965.299366] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c4672bb-17df-4d7f-83ae-fd3f176945a0" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.538129] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ec16ac9-d731-43c2-85c8-d7f8fb5ffd10 req-17ad1ffb-8acf-456d-ad9d-09d48f17b60a service nova] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1965.538429] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ec16ac9-d731-43c2-85c8-d7f8fb5ffd10 req-17ad1ffb-8acf-456d-ad9d-09d48f17b60a service nova] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 1965.538712] env[71051]: INFO networking_nsxv3.common.synchronization [req-0ec16ac9-d731-43c2-85c8-d7f8fb5ffd10 req-17ad1ffb-8acf-456d-ad9d-09d48f17b60a service nova] Enqueued Resource ID: fe09ca58-49c5-43fb-bcf0-c9b632175131 with Priority: HIGHEST for action port [ 1965.539903] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_rules [ 1965.540087] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 1965.540200] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe09ca58-49c5-43fb-bcf0-c9b632175131 with Priority: HIGHEST for action port [ 1965.540504] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.540829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.540829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.540916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.541243] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.546681] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.546845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.550020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.550020] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.550020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe09ca58-49c5-43fb-bcf0-c9b632175131 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.550020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.550020] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe09ca58-49c5-43fb-bcf0-c9b632175131',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.682299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.682509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.682672] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.684157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.684157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.684157] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a already deleted. [ 1965.684157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.684157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.684157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.684157] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.691174] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 in Status: SUCCESS [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.691174] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.691174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.691605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.691605] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.751172] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1965.751515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.751631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.751911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.752030] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.752182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.752219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.752377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.752475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.752538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.752675] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.755938] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.755938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.755938] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1965.865747] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: SUCCESS [ 1965.866045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1965.866251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1965.866494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1965.866615] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.050643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.050830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.051104] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.055727] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe09ca58-49c5-43fb-bcf0-c9b632175131 with status ACTIVE [ 1966.055727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.055818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.056764] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.056764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.057068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.057068] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.057144] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.057175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.057312] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.057400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.057500] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe09ca58-49c5-43fb-bcf0-c9b632175131 is going to be updated. [ 1966.077157] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.077157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.077157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.077157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.077157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.077157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe09ca58-49c5-43fb-bcf0-c9b632175131" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.195303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.195303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.195303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.195303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.195490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.196047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.196047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.196047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.196047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.196047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.196047] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 is going to be deleted. [ 1966.221602] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.221753] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.221820] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.222051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.222412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.222412] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a already deleted. [ 1966.222412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.238402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.238531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.238531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.238701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.238790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.239163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.239163] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.239263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.239543] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.239543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.239543] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.239725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.239725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.239878] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.258447] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.258604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.258825] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.301720] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 in Status: SUCCESS [ 1966.301917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.303060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.303060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.303060] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.303060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.303060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.303399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.303399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.303399] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.385851] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.386310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.386438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.386844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.386844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.386963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be deleted. [ 1966.433309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.433618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.433618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.433775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.433888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.434014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.556406] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.741823] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.742093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.742153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.744180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.744323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.744540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.744707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.744765] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.744925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.745071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.745167] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 already deleted. [ 1966.745241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.745347] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.746300] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.746506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.746685] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.746831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.746890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.747050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.747132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.747221] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.760663] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1966.806575] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.806747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.806821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.807141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.807329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.807473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.807577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.807634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.807802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.807882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.807972] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 is going to be deleted. [ 1966.833582] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.833808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.833876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.834064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.834249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.834249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.834416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.834578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.834765] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1966.834878] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1966.834934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1966.835165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1966.835165] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1966.835297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63d494f1-2f72-4fc0-bede-2bafb6275891',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1967.059873] env[71051]: INFO networking_nsxv3.common.synchronization [None req-236e6005-a43a-478d-acb9-31fdc7704c1e None None] Enqueued Resource ID: c9e3d7be-aea4-45b2-97fe-165146143037 with Priority: HIGHEST for action port [ 1967.061159] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e3d7be-aea4-45b2-97fe-165146143037 with Priority: HIGHEST for action port [ 1967.061159] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9e3d7be-aea4-45b2-97fe-165146143037 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.061159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9e3d7be-aea4-45b2-97fe-165146143037" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.061345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9e3d7be-aea4-45b2-97fe-165146143037" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.061603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9e3d7be-aea4-45b2-97fe-165146143037" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.061656] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9e3d7be-aea4-45b2-97fe-165146143037',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1967.063782] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.063782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.063782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.063782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.063782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.063782] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae is going to be created. [ 1967.093259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.093447] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.093521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.093751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.094377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.107342] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: UNINITIALIZED for 2s [ 1967.249588] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a396f9-0f7f-4c4e-9eb4-a65e45105c56',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1967.253339] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.253339] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.253339] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 already deleted. [ 1967.253339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.263926] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.264212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.264280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.264529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.264566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.264699] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1967.296199] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.296339] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.296405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.296622] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.296786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.308204] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1967.338051] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.338277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.338347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.338602] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.338703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.338915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.339036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.339083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.339301] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.339414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.339559] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63d494f1-2f72-4fc0-bede-2bafb6275891 already deleted. [ 1967.339675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63d494f1-2f72-4fc0-bede-2bafb6275891" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.565774] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9e3d7be-aea4-45b2-97fe-165146143037 [ 1967.566046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.566149] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.566209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.566494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.566589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.566690] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9e3d7be-aea4-45b2-97fe-165146143037 already deleted. [ 1967.566774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9e3d7be-aea4-45b2-97fe-165146143037" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.753586] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a396f9-0f7f-4c4e-9eb4-a65e45105c56: rpc.has_security_group_logging(os_id): False [ 1967.772563] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.772687] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.772745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.772976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.773070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.773309] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.773410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.773477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.773640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.773734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.773804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 is going to be created. [ 1967.793621] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56], does not exist path=[/infra/domains/default/groups/52a396f9-0f7f-4c4e-9eb4-a65e45105c56]."\n}' [ 1967.793762] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56 [ 1967.793848] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1967.829891] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.830106] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.830186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.830407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.831615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.831929] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.832056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.832122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.832364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.832459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.832671] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1967.832774] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1967.832905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1967.832987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1967.833097] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.833190] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a396f9-0f7f-4c4e-9eb4-a65e45105c56 is going to be created. [ 1967.848828] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56], does not exist path=[/infra/domains/default/groups/52a396f9-0f7f-4c4e-9eb4-a65e45105c56]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56 [ 1967.848828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a396f9-0f7f-4c4e-9eb4-a65e45105c56" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1967.848828] env[71051]: Traceback (most recent call last): [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1967.848828] env[71051]: return func(*args, **kwargs) [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1967.848828] env[71051]: res.raise_for_status() [ 1967.848828] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1967.848828] env[71051]: raise HTTPError(http_error_msg, response=self) [ 1967.848828] env[71051]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56 [ 1967.848828] env[71051]: During handling of the above exception, another exception occurred: [ 1967.848828] env[71051]: Traceback (most recent call last): [ 1967.848828] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1967.848828] env[71051]: listener.cb(fileno) [ 1967.848828] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1967.848828] env[71051]: result = function(*args, **kwargs) [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1967.848828] env[71051]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1967.848828] env[71051]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1967.848828] env[71051]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1967.848828] env[71051]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1967.848828] env[71051]: res.raise_for_status() [ 1967.848828] env[71051]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1967.848828] env[71051]: raise HTTPError(http_error_msg, response=self) [ 1967.848828] env[71051]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52a396f9-0f7f-4c4e-9eb4-a65e45105c56 [ 1967.848828] env[71051]: Removing descriptor: 32 [ 1969.118762] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: SUCCESS [ 1969.119175] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1969.119961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1969.120701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1969.120701] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1969.120701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1969.121068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1969.121068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1969.121229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1969.121278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1969.121433] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1969.318030] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1969.318686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1969.318686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1969.318686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1969.318862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1969.318923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1969.318996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1969.319146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1969.319229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1969.319322] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1969.625260] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1969.821873] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1970.131131] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9595df2-c77b-4db7-9132-81bb8d4270ae: rpc.has_security_group_logging(os_id): False [ 1970.148559] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1970.148746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1970.148795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1970.149020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1970.149123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1970.149364] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1970.149468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1970.149534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1970.149755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1970.149893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1970.150036] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae is going to be created. [ 1970.279137] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1970.279265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1970.279338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1970.279596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1970.279831] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1970.289730] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: IN_PROGRESS for 2s [ 1970.324212] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1970.827812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1970.828038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1970.828123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1970.828354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1970.828480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1970.828593] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1970.854126] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1970.854350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1970.854350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1970.854561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1970.854841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1970.866615] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1971.556056] env[71051]: INFO networking_nsxv3.common.synchronization [req-a08cd5fa-58dd-4bcf-96e5-a720d4087dbb req-7822f62f-9967-40d0-b627-44e03295f16f tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 1971.556523] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 1971.556847] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1971.556978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1971.557283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1971.557561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1971.557740] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1971.557833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1971.557886] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1971.558081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1971.558172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1971.558264] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1972.062034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.062034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.062034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.062349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.066029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.066029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a already deleted. [ 1972.066029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.298999] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.299309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.299504] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.299931] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.300270] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.300693] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.301729] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.301729] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.301790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.302026] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1972.302147] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1972.302259] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1972.302368] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1972.302678] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1972.302846] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1972.303029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1972.305142] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: SUCCESS [ 1972.305360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.321139] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1972.321241] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1972.321963] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1972.321963] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.321963] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-74ab74a3-f926-42fe-8c64-e8804cd41f85 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.322152] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.322152] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.323022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.323022] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74ab74a3-f926-42fe-8c64-e8804cd41f85',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1972.396636] env[71051]: INFO networking_nsxv3.common.synchronization [req-238f0f08-3b69-4db2-a482-b3a125f7a0e9 req-ff1de03f-ff28-4009-94b8-a83a6537aaff tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1972.396822] env[71051]: INFO networking_nsxv3.common.synchronization [req-238f0f08-3b69-4db2-a482-b3a125f7a0e9 req-ff1de03f-ff28-4009-94b8-a83a6537aaff tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1972.396981] env[71051]: INFO networking_nsxv3.common.synchronization [req-238f0f08-3b69-4db2-a482-b3a125f7a0e9 req-ff1de03f-ff28-4009-94b8-a83a6537aaff tempest-SecurityGroupsTestJSON-233044353 tempest-SecurityGroupsTestJSON-233044353-project-member] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1972.397640] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593789cb-4e5f-4320-800f-607a06d60888 with Priority: HIGHEST for action security_group_members [ 1972.397640] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGHEST for action security_group_members [ 1972.397760] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGHEST for action security_group_members [ 1972.398141] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.398245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.398409] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.398525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.398590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.398785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.398932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.399039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.399109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.399241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.399324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.399420] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1972.400267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.400393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.400454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.400591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.400731] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.400821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.400884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.401021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.401104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.401187] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1972.826088] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.826398] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.826492] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.826782] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.826963] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.827141] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 74ab74a3-f926-42fe-8c64-e8804cd41f85 not found, creating... [ 1972.827409] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.827576] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.827701] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.827934] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.828093] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.828386] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.828549] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.828671] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.828952] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.829034] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.829185] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 74ab74a3-f926-42fe-8c64-e8804cd41f85 is going to be created. [ 1972.847310] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.847559] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.847659] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.847921] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.848161] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.848397] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.876574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1972.876797] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.877048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.877280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.877468] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.877577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.877649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.877787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.877900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.877957] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1972.903344] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.903466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.903510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.904158] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.905375] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.905522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.924585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.924873] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.925007] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.925080] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.925277] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.925368] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.925480] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 is going to be updated. [ 1972.926743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.926743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.954093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.954341] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.954464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.954533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.954793] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.954884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.954979] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be updated. [ 1972.975113] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.975249] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.975292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.975483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.975615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1972.984175] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: IN_PROGRESS for 2s [ 1972.998028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1972.998028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1972.998028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1972.998028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1972.998028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1973.007930] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: IN_PROGRESS for 2s [ 1973.380724] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.381779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.381779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.382507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.401859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1973.402448] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.402448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.402448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.402714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.402714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1973.402714] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1973.428607] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.428836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.428907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.429136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.429294] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1973.439023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1973.557189] env[71051]: INFO networking_nsxv3.common.synchronization [req-a08cd5fa-58dd-4bcf-96e5-a720d4087dbb req-36a9d4f0-82f4-4e75-a36e-2a53c6090e38 service nova] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1973.557372] env[71051]: INFO networking_nsxv3.common.synchronization [req-a08cd5fa-58dd-4bcf-96e5-a720d4087dbb req-36a9d4f0-82f4-4e75-a36e-2a53c6090e38 service nova] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 1973.557644] env[71051]: INFO networking_nsxv3.common.synchronization [req-a08cd5fa-58dd-4bcf-96e5-a720d4087dbb req-36a9d4f0-82f4-4e75-a36e-2a53c6090e38 service nova] Enqueued Resource ID: 74ab74a3-f926-42fe-8c64-e8804cd41f85 with Priority: HIGHEST for action port [ 1973.558572] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_rules [ 1973.558729] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 1973.558837] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ab74a3-f926-42fe-8c64-e8804cd41f85 with Priority: HIGHEST for action port [ 1973.559194] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.559343] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.559458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.559609] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.559689] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1973.560723] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.560842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.560906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.561115] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.561319] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.561438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.561503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.561653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.561754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1973.561864] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1973.562743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-74ab74a3-f926-42fe-8c64-e8804cd41f85 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1973.562881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1973.562953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1973.563253] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1973.563253] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74ab74a3-f926-42fe-8c64-e8804cd41f85',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1974.065514] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1974.065860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1974.065860] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1974.067426] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74ab74a3-f926-42fe-8c64-e8804cd41f85 with status ACTIVE [ 1974.067787] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1974.067883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1974.067883] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1974.068137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1974.068558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1974.068558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1974.068713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1974.068713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1974.068877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1974.068983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1974.069299] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1974.069351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1974.069460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1974.069637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1974.069742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1974.069836] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74ab74a3-f926-42fe-8c64-e8804cd41f85 is going to be updated. [ 1974.091567] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1974.091721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1974.091823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1974.092100] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1974.092271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1974.092446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74ab74a3-f926-42fe-8c64-e8804cd41f85" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1974.569303] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1974.994756] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44ee8ef-f57d-42d4-b308-e057c9153016 in Status: SUCCESS [ 1974.994961] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 deletion is rescheduled due to dependency. [ 1974.995094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.015938] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d in Status: SUCCESS [ 1975.016145] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d deletion is rescheduled due to dependency. [ 1975.016265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.072310] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.072705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.072705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.072863] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.073016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.073164] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a is going to be created. [ 1975.096601] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.096838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.096838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.097136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.097303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.105718] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: UNINITIALIZED for 2s [ 1975.446922] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1975.447439] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 deletion is rescheduled due to dependency. [ 1975.447439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.447570] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.447813] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.447968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.448143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.448241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.448423] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.448514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.448614] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.448794] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-593789cb-4e5f-4320-800f-607a06d60888 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.448885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.448979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.449176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.449349] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.449489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.449489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.449694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.449795] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.449881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.449980] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1975.450985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.451216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.451372] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.451490] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.451562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.451731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.451844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.451960] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1975.953568] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 593789cb-4e5f-4320-800f-607a06d60888: rpc.has_security_group_logging(os_id): False [ 1975.956457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.956628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.956661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.956864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.956970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.957189] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.957318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.957359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.957492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.957566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.957653] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1975.970244] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.970373] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.970417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.970582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.970666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.970841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.970941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.971008] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.971160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.971235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.971439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.971532] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.971659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.971726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.971801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.971990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.972094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.972156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.972291] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.972493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.972589] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be updated. [ 1975.983699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1975.983828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1975.983873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1975.984929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1975.984929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1975.991334] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1976.031065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1976.031065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1976.031065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1976.031065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1976.031328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1976.042807] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: IN_PROGRESS for 2s [ 1977.117348] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: SUCCESS [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1977.117348] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1977.117348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1977.117348] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1977.619548] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1978.001781] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1978.001991] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 593789cb-4e5f-4320-800f-607a06d60888 deletion is rescheduled due to dependency. [ 1978.002147] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.059041] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 593789cb-4e5f-4320-800f-607a06d60888 in Status: SUCCESS [ 1978.059224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.059417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.059648] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.059740] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1978.121633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cf609a9-a0fd-4fd9-894c-95d77014571a: rpc.has_security_group_logging(os_id): False [ 1978.142180] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1978.142360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1978.142406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.142610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.142695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.142936] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1978.143044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1978.143105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.143256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.143329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.143453] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a is going to be created. [ 1978.203026] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1978.203026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1978.203026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.203026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.203026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.209804] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: IN_PROGRESS for 2s [ 1978.560043] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1978.560159] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1978.582106] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1978.582323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1978.582420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.582591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.582670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.582799] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 is going to be deleted. [ 1978.629779] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1978.629982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1978.629982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.630251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.630354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.630469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1978.630607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1978.630782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1978.630875] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1979.149711] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1979.150170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1979.150170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1979.150255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1979.150320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1979.150435] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 already deleted. [ 1979.150518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1979.150702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1979.150905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1979.150992] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('593789cb-4e5f-4320-800f-607a06d60888',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1979.671205] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1979.671421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1979.671463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1979.671916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1979.672052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1979.672201] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 593789cb-4e5f-4320-800f-607a06d60888 already deleted. [ 1979.672283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-593789cb-4e5f-4320-800f-607a06d60888" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1980.221997] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: SUCCESS [ 1980.221997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1983.561893] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1983.561893] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1987.146212] env[71051]: INFO networking_nsxv3.common.synchronization [req-9663dd61-d931-48e5-96d2-7cf09b136711 req-6525abb1-5e4e-41b4-8ef5-b2cac79645a9 tempest-ServersNegativeTestJSON-1063350002 tempest-ServersNegativeTestJSON-1063350002-project-member] Enqueued Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1987.146874] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 with Priority: HIGHEST for action security_group_members [ 1987.147076] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-371c9558-8dd8-4739-882d-f7fbf1f26c54 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.147310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1987.147397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1987.147632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1987.147784] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.147889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1987.147969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1987.148492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1987.148492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1987.148492] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('371c9558-8dd8-4739-882d-f7fbf1f26c54',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1987.651152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.651341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1987.651412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1987.651626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1987.672353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1987.672613] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.672734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1987.672880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1987.673109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1987.673199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1987.673293] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 is going to be updated. [ 1987.722264] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.722479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1987.722550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1987.722805] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1987.723035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1987.732497] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: IN_PROGRESS for 2s [ 1989.744178] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 in Status: SUCCESS [ 1989.744450] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 371c9558-8dd8-4739-882d-f7fbf1f26c54 deletion is rescheduled due to dependency. [ 1989.744450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-371c9558-8dd8-4739-882d-f7fbf1f26c54" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1992.148042] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1992.148483] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1997.108686] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.109011] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.109053] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.109321] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.109592] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.109816] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.109947] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.110182] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.110336] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.110552] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1997.110675] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1997.110790] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1997.110907] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1997.111040] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1997.111156] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1997.111300] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1997.130492] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1997.130671] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1997.130814] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1997.130995] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-779" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.131315] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.131491] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.131614] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.131870] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.132025] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6b2f7-5db2-4611-91e3-3ef73ddd8b28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1997.148839] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1997.148969] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1997.634572] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.634802] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.635040] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.635351] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.635514] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.635825] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.636010] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.636178] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.636409] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.636556] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.636846] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.637105] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.637250] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.637471] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.637615] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.637767] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 is going to be updated. [ 1997.656727] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.656904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1997.657048] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1997.657282] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1997.657470] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1997.657689] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.367387] env[71051]: INFO networking_nsxv3.common.synchronization [req-245eb883-9e81-47a1-bea1-426bdc913c1e req-11bb471c-32eb-4a6c-86bf-6fe01d0d0de4 service nova] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1998.367654] env[71051]: INFO networking_nsxv3.common.synchronization [req-245eb883-9e81-47a1-bea1-426bdc913c1e req-11bb471c-32eb-4a6c-86bf-6fe01d0d0de4 service nova] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1998.367746] env[71051]: INFO networking_nsxv3.common.synchronization [req-245eb883-9e81-47a1-bea1-426bdc913c1e req-11bb471c-32eb-4a6c-86bf-6fe01d0d0de4 service nova] Enqueued Resource ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with Priority: HIGHEST for action port [ 1998.368014] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_rules [ 1998.368159] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 1998.368272] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with Priority: HIGHEST for action port [ 1998.368850] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.368970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.369059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.369289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.369374] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.370217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.370344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.370412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.370578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.370751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.370847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.370910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.371084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.371172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.371261] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.371968] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.374911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.375022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.375196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.375274] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6b2f7-5db2-4611-91e3-3ef73ddd8b28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.876642] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.877765] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.877933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.878229] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 with status ACTIVE [ 1998.878427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.878518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.878560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.878738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.878828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.878995] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.879105] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.879187] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.879316] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.879390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.880276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.880276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.880276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.880276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.880276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.880276] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b6b2f7-5db2-4611-91e3-3ef73ddd8b28 is going to be updated. [ 1998.899441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.899679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1998.899819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1998.900134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1998.900385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1998.900606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b6b2f7-5db2-4611-91e3-3ef73ddd8b28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1999.379634] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1999.882369] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.882582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1999.882582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1999.882804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1999.882899] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1999.883019] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be updated. [ 1999.909901] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.910051] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1999.910120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1999.910386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1999.910536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1999.918888] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: IN_PROGRESS for 2s [ 2001.930160] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: SUCCESS [ 2001.930600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.930745] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.931038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.931310] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.931515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.931653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.931890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.932049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.932206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.932374] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2002.434183] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2002.938412] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a44db054-67f6-416b-8627-f64892f0cf47: rpc.has_security_group_logging(os_id): False [ 2002.954699] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.954926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2002.955385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2002.955385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2002.972360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2002.972657] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.972875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2002.972875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2002.973109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2002.973201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2002.973293] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be updated. [ 2003.032786] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2003.033054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2003.033054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2003.033267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2003.033414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2003.044581] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: IN_PROGRESS for 2s [ 2003.369390] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2003.369507] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2005.059591] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: SUCCESS [ 2005.060104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2008.370806] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2008.370806] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2009.868398] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2009.868732] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2009.868732] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2009.869018] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2009.869297] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2009.869465] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2009.869590] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2009.869818] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2009.869971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2009.870203] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2009.870324] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2009.870439] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2009.870553] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2009.870669] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2009.870780] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2009.870921] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2009.889821] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2009.889976] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2009.890140] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2009.890309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-691" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2009.890592] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-6d193a34-fdde-419e-b264-7798a29965a5 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2009.890759] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2009.890893] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2009.891165] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2009.891324] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d193a34-fdde-419e-b264-7798a29965a5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2010.394070] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.394300] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.394434] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.394712] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.394869] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.395257] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.395476] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.395551] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.395775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.395981] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.396292] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.396458] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.396581] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.396792] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.396934] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.397095] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 6d193a34-fdde-419e-b264-7798a29965a5 is going to be updated. [ 2010.416826] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.417350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.417350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.417350] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.417545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.417765] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.099883] env[71051]: INFO networking_nsxv3.common.synchronization [req-e71c4881-6c87-43db-bb43-eba6544e499f req-444bd4b6-1977-4098-a8e9-75b67e6c6677 service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 2011.100151] env[71051]: INFO networking_nsxv3.common.synchronization [req-e71c4881-6c87-43db-bb43-eba6544e499f req-444bd4b6-1977-4098-a8e9-75b67e6c6677 service nova] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 2011.100249] env[71051]: INFO networking_nsxv3.common.synchronization [req-e71c4881-6c87-43db-bb43-eba6544e499f req-444bd4b6-1977-4098-a8e9-75b67e6c6677 service nova] Enqueued Resource ID: 6d193a34-fdde-419e-b264-7798a29965a5 with Priority: HIGHEST for action port [ 2011.100448] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_rules [ 2011.100578] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 2011.100677] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193a34-fdde-419e-b264-7798a29965a5 with Priority: HIGHEST for action port [ 2011.101229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.101405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.101405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.101603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.101798] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.102539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.102601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.102661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.102815] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.102958] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.103064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.103122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.103261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.103349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.103435] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.104100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d193a34-fdde-419e-b264-7798a29965a5 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.104207] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.104293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.104575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.104575] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d193a34-fdde-419e-b264-7798a29965a5',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.606473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.606603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.606811] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.607707] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d193a34-fdde-419e-b264-7798a29965a5 with status ACTIVE [ 2011.607894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.608013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.608090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.608931] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.608931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.609365] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.609365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.609365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.609365] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.609504] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.609504] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d193a34-fdde-419e-b264-7798a29965a5 is going to be updated. [ 2011.629523] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.629717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.629717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.629913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.630087] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.630257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d193a34-fdde-419e-b264-7798a29965a5" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.111408] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2012.613240] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.613453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.613453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.613679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.613770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.613869] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 2012.644320] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.644553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.644619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.644829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.645020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.653595] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 2014.663659] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 2014.664053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.664053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.664256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.664457] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.664605] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.664671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.664830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.664911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.665055] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.665149] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2015.167821] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2015.669792] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c8230f-81e9-43ef-8adc-85278751b6d7: rpc.has_security_group_logging(os_id): False [ 2015.687015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2015.687216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2015.687327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2015.687610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2015.708320] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.708625] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2015.708751] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2015.708836] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2015.709049] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2015.709137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.709231] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 2015.765324] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2015.765573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2015.765573] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2015.765746] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2015.765890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.781529] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 2016.101880] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2016.102109] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2017.797330] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 2017.797633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2021.103136] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2021.103423] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2026.104651] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2026.104651] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2029.088788] env[71051]: INFO networking_nsxv3.common.synchronization [req-eb74b298-5b5b-4354-91aa-5b2642e26fcf req-b701856e-300d-4165-8f7b-2faa9a35e835 tempest-ServerActionsTestOtherB-1890191891 tempest-ServerActionsTestOtherB-1890191891-project-member] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 2029.089334] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGHEST for action security_group_members [ 2029.090139] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.090139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.090139] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.090381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.090546] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.091032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.091032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.091032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.091032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2029.091241] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.593243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.593444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.593520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.593778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.593898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2029.594138] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.594251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.594337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.594501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.594610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2029.594719] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be updated. [ 2029.622396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.622584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.622584] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.622747] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.622882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2029.629944] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: IN_PROGRESS for 2s [ 2030.118336] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fa1afb52-6810-4d72-8cb2-91f1c588f8a1 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2030.118909] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2030.119221] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2030.119347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2030.119404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2030.119659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2030.119744] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2030.181757] env[71051]: INFO networking_nsxv3.common.synchronization [None req-eeeaacd9-9a64-40ec-ba67-624632651008 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2030.182264] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2030.182563] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2030.182871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2030.645598] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2030.646078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2030.646744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2030.647114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2030.648665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2030.648665] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca1388-21b4-449b-a002-937897e090a9 already deleted. [ 2030.648665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2030.648665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2030.648665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2030.648665] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2031.167509] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.167897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2031.167897] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2031.168073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2031.168073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2031.168710] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca1388-21b4-449b-a002-937897e090a9 already deleted. [ 2031.168710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2031.650807] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 in Status: SUCCESS [ 2031.651013] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 deletion is rescheduled due to dependency. [ 2031.651137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2031.898938] env[71051]: INFO networking_nsxv3.common.synchronization [req-ce905ca6-d4a1-4feb-b1b1-a60f800bc4b0 req-526543fb-94da-4090-8c0c-be7ec38831cb tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 2031.899114] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGHEST for action security_group_members [ 2031.899430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.899607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2031.899607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2031.899808] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2031.899960] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.900415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2031.900497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2031.900851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2031.900851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2031.900851] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2032.403055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2032.403436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2032.403436] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2032.403514] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2032.424041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2032.424283] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2032.424400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2032.424469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2032.424677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2032.424754] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2032.424849] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 896db215-283f-4c81-b855-943659d9edda is going to be updated. [ 2032.448229] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2032.448416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2032.448416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2032.448620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2032.448759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2032.456799] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 896db215-283f-4c81-b855-943659d9edda in Status: IN_PROGRESS for 2s [ 2034.469433] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 896db215-283f-4c81-b855-943659d9edda in Status: SUCCESS [ 2034.469825] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 896db215-283f-4c81-b855-943659d9edda deletion is rescheduled due to dependency. [ 2034.469825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2035.648949] env[71051]: INFO networking_nsxv3.common.synchronization [req-0fb8c987-c3a6-47e1-ac37-310f053ab38b req-8b298c9b-1cd3-4a99-80af-1466bfaf41d7 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2035.650191] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2035.654039] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2035.654039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2035.654039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2035.654230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2035.654271] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2035.654629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2035.654629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2035.654629] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2035.654758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2035.654758] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2035.909027] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2035.909027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2035.909027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2035.909027] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2035.909027] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2035.909444] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2035.909699] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2035.910046] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2035.910348] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2035.910726] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2035.910976] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2035.911282] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2035.911637] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2035.911930] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2035.912186] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2035.912473] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2035.932544] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2035.933524] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2035.933524] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2035.933524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2035.933524] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-a1a51512-fa48-4616-a469-adbc8cf31252 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2035.933524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2035.933809] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2035.933955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2035.934108] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a51512-fa48-4616-a469-adbc8cf31252',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2036.159659] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.159659] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.159659] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca1388-21b4-449b-a002-937897e090a9 already deleted. [ 2036.159659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.442387] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.442387] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port a1a51512-fa48-4616-a469-adbc8cf31252 not found, creating... [ 2036.442387] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.442387] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.442885] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.442885] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.442885] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.442885] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.443186] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.443951] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: a1a51512-fa48-4616-a469-adbc8cf31252 is going to be created. [ 2036.465462] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2036.465462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2036.465462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2036.465462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2036.465462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2036.465462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.153436] env[71051]: INFO networking_nsxv3.common.synchronization [req-0fb8c987-c3a6-47e1-ac37-310f053ab38b req-410168c2-5a3f-4c26-82b4-fd25fe951754 service nova] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2037.153436] env[71051]: INFO networking_nsxv3.common.synchronization [req-0fb8c987-c3a6-47e1-ac37-310f053ab38b req-410168c2-5a3f-4c26-82b4-fd25fe951754 service nova] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2037.153702] env[71051]: INFO networking_nsxv3.common.synchronization [req-0fb8c987-c3a6-47e1-ac37-310f053ab38b req-410168c2-5a3f-4c26-82b4-fd25fe951754 service nova] Enqueued Resource ID: a1a51512-fa48-4616-a469-adbc8cf31252 with Priority: HIGHEST for action port [ 2037.153829] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_rules [ 2037.153962] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2037.154071] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51512-fa48-4616-a469-adbc8cf31252 with Priority: HIGHEST for action port [ 2037.154653] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.154757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.154842] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.155212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.155337] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2037.156535] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.158404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.158441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.158613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.158771] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.158995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.158995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.159086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.159284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.159382] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2037.160286] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a51512-fa48-4616-a469-adbc8cf31252 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.160448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.160448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.161849] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.161849] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a51512-fa48-4616-a469-adbc8cf31252',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2037.662863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.663093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.663407] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2037.664334] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1a51512-fa48-4616-a469-adbc8cf31252 with status ACTIVE [ 2037.664787] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.664898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.664898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.665344] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.665593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.665593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.665780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.665780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.666010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.666010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.666191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.666278] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.666331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.666476] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.666554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.666670] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1a51512-fa48-4616-a469-adbc8cf31252 is going to be updated. [ 2037.688693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2037.688893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2037.688971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2037.689174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2037.689304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2037.689452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a51512-fa48-4616-a469-adbc8cf31252" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2038.171024] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2038.676402] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2038.676589] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2038.676638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2038.676834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2038.676931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2038.677049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca1388-21b4-449b-a002-937897e090a9 is going to be created. [ 2038.707330] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2038.707330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2038.707330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2038.707330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2038.707330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2038.719902] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: UNINITIALIZED for 2s [ 2038.769514] env[71051]: INFO networking_nsxv3.common.synchronization [req-c60e990c-2e82-4185-afcc-49a110d2217a req-3120c47c-18e8-4f60-b8f5-4026bc3509f3 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 2038.770152] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGHEST for action security_group_members [ 2038.770908] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2038.771093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2038.771190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2038.771416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2038.771645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2038.771791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2038.771875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2038.772062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2038.773575] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2038.773700] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2039.201813] env[71051]: INFO networking_nsxv3.common.synchronization [None req-0111d216-0ef9-4614-9bd2-13299df0eba9 None None] Enqueued Resource ID: 95b7d166-910b-43e8-9cb8-21c3ab6c49c2 with Priority: HIGHEST for action port [ 2039.202089] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b7d166-910b-43e8-9cb8-21c3ab6c49c2 with Priority: HIGHEST for action port [ 2039.202707] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b7d166-910b-43e8-9cb8-21c3ab6c49c2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2039.202770] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b7d166-910b-43e8-9cb8-21c3ab6c49c2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2039.202868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b7d166-910b-43e8-9cb8-21c3ab6c49c2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2039.203071] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b7d166-910b-43e8-9cb8-21c3ab6c49c2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2039.203695] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b7d166-910b-43e8-9cb8-21c3ab6c49c2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2039.278549] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2039.280981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2039.280981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2039.280981] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2039.304794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2039.304794] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2039.304794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2039.304794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2039.304794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2039.304794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2039.304794] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a is going to be updated. [ 2039.328313] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2039.328313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2039.328313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2039.328313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2039.328313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2039.334944] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: IN_PROGRESS for 2s [ 2039.706353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95b7d166-910b-43e8-9cb8-21c3ab6c49c2 [ 2039.706353] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2039.706353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2039.706353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2039.706353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2039.706353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2039.706353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95b7d166-910b-43e8-9cb8-21c3ab6c49c2 already deleted. [ 2039.706353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b7d166-910b-43e8-9cb8-21c3ab6c49c2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2040.729695] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: SUCCESS [ 2040.729983] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2040.730114] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2040.730338] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2040.730562] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2040.730690] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2040.730766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2040.730929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2040.731096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2040.731156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2040.731233] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2041.234629] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2041.334948] env[71051]: INFO networking_nsxv3.common.synchronization [None req-639187c3-d239-44d5-bcf3-66dab7f041e8 None None] Enqueued Resource ID: 63cad3de-bdb2-4904-b09a-2146fa3fc7d1 with Priority: HIGHEST for action port [ 2041.337957] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cad3de-bdb2-4904-b09a-2146fa3fc7d1 with Priority: HIGHEST for action port [ 2041.337957] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-63cad3de-bdb2-4904-b09a-2146fa3fc7d1 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2041.337957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63cad3de-bdb2-4904-b09a-2146fa3fc7d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2041.337957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63cad3de-bdb2-4904-b09a-2146fa3fc7d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2041.337957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63cad3de-bdb2-4904-b09a-2146fa3fc7d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2041.337957] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cad3de-bdb2-4904-b09a-2146fa3fc7d1',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2041.347038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a in Status: SUCCESS [ 2041.347038] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a deletion is rescheduled due to dependency. [ 2041.347254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2041.736518] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca1388-21b4-449b-a002-937897e090a9: rpc.has_security_group_logging(os_id): False [ 2041.757401] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2041.757549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2041.757601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2041.757804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2041.757895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2041.758222] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2041.758222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2041.758363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2041.758438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2041.758502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2041.758602] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca1388-21b4-449b-a002-937897e090a9 is going to be created. [ 2041.826813] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2041.826978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2041.827056] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2041.827232] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2041.827404] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2041.839523] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: IN_PROGRESS for 2s [ 2041.839713] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63cad3de-bdb2-4904-b09a-2146fa3fc7d1 [ 2041.839882] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2041.839986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2041.840067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2041.840219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2041.840298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2041.840383] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63cad3de-bdb2-4904-b09a-2146fa3fc7d1 already deleted. [ 2041.840463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63cad3de-bdb2-4904-b09a-2146fa3fc7d1" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2042.590570] env[71051]: INFO networking_nsxv3.common.synchronization [req-56c9c4b3-882f-411c-b01e-cae3c451b47e req-566f106c-c302-4f73-9923-45a834d603ce tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2042.591176] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2042.591558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2042.591681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2042.591761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2042.591940] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2042.593342] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2042.593467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2042.593530] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2042.593697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2042.593810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2042.593909] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2042.835529] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2042.835862] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2042.835862] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2042.836171] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2042.836446] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2042.836614] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2042.836739] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2042.836968] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2042.837299] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2042.837529] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2042.837650] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2042.837765] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2042.837880] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2042.838096] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2042.838160] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2042.838250] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2042.855683] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2042.855855] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2042.856009] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2042.856218] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2042.856525] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-3fda7324-e443-41d7-9709-10cd1326a355 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2042.856700] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2042.856829] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2042.857162] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2042.857314] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fda7324-e443-41d7-9709-10cd1326a355',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2043.097129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.097311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.097502] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.097758] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.132946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.133282] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.133465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.133548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.133748] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.133834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.133929] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be updated. [ 2043.156239] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.156419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.156463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.156626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.156757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.164560] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 2043.359707] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.359707] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.359943] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.360195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.360394] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.360593] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 3fda7324-e443-41d7-9709-10cd1326a355 not found, creating... [ 2043.360899] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.361112] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.361288] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.361556] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.361738] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.362073] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.362245] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.362410] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.362667] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.362898] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.363127] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 3fda7324-e443-41d7-9709-10cd1326a355 is going to be created. [ 2043.383235] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2043.383456] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2043.383623] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2043.383837] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2043.384138] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.384453] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2043.850232] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: SUCCESS [ 2043.850597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.063204] env[71051]: INFO networking_nsxv3.common.synchronization [req-56c9c4b3-882f-411c-b01e-cae3c451b47e req-d84e8ed4-27a1-4adb-add8-3043b6ed7469 service nova] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_rules [ 2044.063408] env[71051]: INFO networking_nsxv3.common.synchronization [req-56c9c4b3-882f-411c-b01e-cae3c451b47e req-d84e8ed4-27a1-4adb-add8-3043b6ed7469 service nova] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2044.063558] env[71051]: INFO networking_nsxv3.common.synchronization [req-56c9c4b3-882f-411c-b01e-cae3c451b47e req-d84e8ed4-27a1-4adb-add8-3043b6ed7469 service nova] Enqueued Resource ID: 3fda7324-e443-41d7-9709-10cd1326a355 with Priority: HIGHEST for action port [ 2044.063783] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_rules [ 2044.063907] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2044.064008] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fda7324-e443-41d7-9709-10cd1326a355 with Priority: HIGHEST for action port [ 2044.064539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.064666] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.064734] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.064929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.065965] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2044.066946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.067078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.067288] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fda7324-e443-41d7-9709-10cd1326a355 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.067391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.067456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.067634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.067712] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fda7324-e443-41d7-9709-10cd1326a355',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2044.570910] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.571063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.573540] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fda7324-e443-41d7-9709-10cd1326a355 with status ACTIVE [ 2044.573638] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.574518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.575396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.575396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.575396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.575396] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.575396] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.575786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.575786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.575786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.575879] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.575984] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.576043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.576771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.576771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.576771] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fda7324-e443-41d7-9709-10cd1326a355 is going to be updated. [ 2044.598251] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.598389] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.598463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.598656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.598786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.598937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2044.790830] env[71051]: INFO networking_nsxv3.common.synchronization [None req-6a56f222-1035-4d57-bf89-430c93a0844a tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2044.793146] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2044.793146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.794305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2044.794561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2044.794810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2044.794930] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2044.866674] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c38fa238-4354-439c-8452-e6898d13d8bf tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2044.866674] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2044.866674] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2044.866674] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2045.177063] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 2045.177063] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da deletion is rescheduled due to dependency. [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2045.177063] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2045.177063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2045.177063] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2045.314081] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2045.314281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2045.314358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2045.314567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2045.314657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2045.314754] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 already deleted. [ 2045.314838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2045.315453] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2045.315634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2045.315744] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2045.678976] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2045.835971] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2045.836244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2045.836244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2045.836487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2045.836571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2045.836684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 already deleted. [ 2045.836782] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2046.181575] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2046.514433] env[71051]: INFO networking_nsxv3.common.synchronization [req-afe1f77f-18a6-47eb-8c59-3e7a804f1614 req-139969bd-f9aa-4d73-bb62-35ad730fadf0 tempest-ServerPasswordTestJSON-1668095546 tempest-ServerPasswordTestJSON-1668095546-project-member] Enqueued Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2046.514959] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2046.515331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2046.515462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2046.515527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2046.515778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2046.515931] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2046.516042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2046.516206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2046.516410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2046.516500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2046.516597] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2046.684181] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2046.684521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2046.684521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2046.684682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2046.684682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2046.684818] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be updated. [ 2046.711300] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2046.711558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2046.711558] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2046.711675] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2046.711809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2046.731618] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 2047.018259] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.018431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.018486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.018702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.018796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.018987] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.019098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.019157] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.019306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.019388] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.019475] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f already deleted. [ 2047.019555] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.230427] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.230775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-829" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.230775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-829" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.231195] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-829" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.231375] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.231570] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.231694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.231915] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.232095] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.232312] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2047.232433] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2047.232546] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2047.232658] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2047.232772] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2047.232882] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2047.233084] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2047.252688] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2047.252688] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2047.252688] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2047.252979] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-829" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.253180] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-3f66a64e-4f84-4ff4-8d8d-951305c6b527 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.253324] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.253474] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.253770] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.253914] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f66a64e-4f84-4ff4-8d8d-951305c6b527',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2047.756132] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.756426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.756546] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.756832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.757022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.757174] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 3f66a64e-4f84-4ff4-8d8d-951305c6b527 not found, creating... [ 2047.757465] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.757633] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.757735] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.757934] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.758089] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.758372] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.758533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.758654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.758863] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.759007] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.759160] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 3f66a64e-4f84-4ff4-8d8d-951305c6b527 is going to be created. [ 2047.777405] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2047.777596] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2047.777725] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2047.777978] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2047.778217] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2047.778446] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2048.566781] env[71051]: INFO networking_nsxv3.common.synchronization [req-afe1f77f-18a6-47eb-8c59-3e7a804f1614 req-c8ca5d00-6b90-4d9b-9426-353a02402926 service nova] Enqueued Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_rules [ 2048.566781] env[71051]: INFO networking_nsxv3.common.synchronization [req-afe1f77f-18a6-47eb-8c59-3e7a804f1614 req-c8ca5d00-6b90-4d9b-9426-353a02402926 service nova] Enqueued Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2048.567078] env[71051]: INFO networking_nsxv3.common.synchronization [req-afe1f77f-18a6-47eb-8c59-3e7a804f1614 req-c8ca5d00-6b90-4d9b-9426-353a02402926 service nova] Enqueued Resource ID: 3f66a64e-4f84-4ff4-8d8d-951305c6b527 with Priority: HIGHEST for action port [ 2048.568100] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_rules [ 2048.568100] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2048.568100] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f66a64e-4f84-4ff4-8d8d-951305c6b527 with Priority: HIGHEST for action port [ 2048.568100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.568616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2048.568616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.568819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.569016] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.570709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.571181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2048.571276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.571618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.571691] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.571874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2048.571961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.572238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.572238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2048.572345] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.573510] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f66a64e-4f84-4ff4-8d8d-951305c6b527 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.573640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2048.573732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.573875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.573991] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f66a64e-4f84-4ff4-8d8d-951305c6b527',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.743250] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 2048.743525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2048.743736] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.743986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.744211] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.744349] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2048.744422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2048.744619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2048.744713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2048.744824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2048.744937] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.071936] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.072093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.074838] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.075395] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f66a64e-4f84-4ff4-8d8d-951305c6b527 with status ACTIVE [ 2049.075581] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.075702] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.075763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.075967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.076068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.076303] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.076419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.076493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.076620] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.076707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.076876] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.076970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.077030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.077169] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.077242] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.077327] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f66a64e-4f84-4ff4-8d8d-951305c6b527 is going to be updated. [ 2049.100387] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.100660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.100660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.100785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.100902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.101078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f66a64e-4f84-4ff4-8d8d-951305c6b527" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.247223] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.247394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.247518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.247681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.247848] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.247946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.248012] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.248170] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.248259] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.248348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.248499] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.248591] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.248649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.248794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.248929] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.249028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.249088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.249250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.249325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.249406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.249496] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.580203] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.751726] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbb6d1cf-c327-4448-b44d-5e5de4b300da: rpc.has_security_group_logging(os_id): False [ 2049.769185] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.769340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.769390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.769619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.769710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.770110] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.770110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.770110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.770289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.770379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.770568] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.770662] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.770717] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.770856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.770929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.771243] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.771243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.771243] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.771464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.771464] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.771525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be updated. [ 2049.826770] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.826930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2049.827052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2049.827245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2049.827399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2049.838963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 2050.083719] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.084037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.084037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.084211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.084310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.084422] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f is going to be created. [ 2050.109519] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.109742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.109821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.110054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.110238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.118329] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: UNINITIALIZED for 2s [ 2050.210755] env[71051]: INFO networking_nsxv3.common.synchronization [req-e0da4a57-98ec-4383-8f92-09776fde6a24 req-6fc216f2-101f-4b35-9148-601babb5ee84 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2050.211376] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2050.212462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.212610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.212679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.212933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.213135] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.213271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.213309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.213445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.213533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.213626] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2050.530732] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.530955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.531094] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.531401] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.531667] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.531832] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.531954] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.532264] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.532443] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.532638] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2050.532755] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2050.532867] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2050.532978] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2050.533108] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2050.533221] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2050.533363] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2050.551417] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2050.551622] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2050.551770] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2050.551941] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.552326] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.552525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.552636] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.552989] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.553230] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ff3bf8-5f73-470d-bbf4-cb75b1abf94f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2050.715963] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.716387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.716387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.716488] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.716608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.716782] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.716884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2050.716946] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2050.717119] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2050.717216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2050.717300] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 already deleted. [ 2050.717391] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.055831] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.056074] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.056214] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.056497] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.056654] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.056813] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f not found, creating... [ 2051.057086] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.057249] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.057375] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.057591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.057734] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.058031] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.058199] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.058324] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.058535] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.058673] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.059044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f is going to be created. [ 2051.078706] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.078920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.079063] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.079364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.079596] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.079825] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.355977] env[71051]: INFO networking_nsxv3.common.synchronization [req-057b709b-fd5d-4a04-82cf-bbfeb281d56f req-2b32446a-18d0-49bc-8736-0f5e0e330623 tempest-AttachVolumeShelveTestJSON-599210745 tempest-AttachVolumeShelveTestJSON-599210745-project-member] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 2051.356571] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGHEST for action security_group_members [ 2051.356874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.357007] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.357081] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.357295] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.357462] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.357579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.357651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.357848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.357974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.358041] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.860441] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.860903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.860903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.860903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.861108] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.861160] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.861255] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.861375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.861526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.861526] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.861678] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be updated. [ 2051.865881] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 2051.866088] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.868331] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c0a25bf-906c-48e0-bf7e-f4a66eabc463 req-a0cbb80c-c742-4698-9c7c-b144631493c1 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2051.868776] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGHEST for action security_group_members [ 2051.869076] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.869190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.869263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.869412] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.869556] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.869651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.869711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.869847] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.869923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.870027] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.915622] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.915812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.915858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.916069] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.916319] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.928769] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: IN_PROGRESS for 2s [ 2051.939363] env[71051]: INFO networking_nsxv3.common.synchronization [req-e0da4a57-98ec-4383-8f92-09776fde6a24 req-b60ca371-0ebb-4a8c-b696-4c41499fbdf9 service nova] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2051.939476] env[71051]: INFO networking_nsxv3.common.synchronization [req-e0da4a57-98ec-4383-8f92-09776fde6a24 req-b60ca371-0ebb-4a8c-b696-4c41499fbdf9 service nova] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2051.940630] env[71051]: INFO networking_nsxv3.common.synchronization [req-e0da4a57-98ec-4383-8f92-09776fde6a24 req-b60ca371-0ebb-4a8c-b696-4c41499fbdf9 service nova] Enqueued Resource ID: 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f with Priority: HIGHEST for action port [ 2051.940630] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2051.940630] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2051.940630] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f with Priority: HIGHEST for action port [ 2051.940630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.940630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.941363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.941363] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.941363] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.941813] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.941933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.941995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.942182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.942338] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.942752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.942854] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.942990] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.943063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2051.943189] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.943873] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.944030] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.944101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.944269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.944429] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ff3bf8-5f73-470d-bbf4-cb75b1abf94f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.950309] env[71051]: INFO networking_nsxv3.common.synchronization [req-6c0a25bf-906c-48e0-bf7e-f4a66eabc463 req-a0cbb80c-c742-4698-9c7c-b144631493c1 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: 3fda7324-e443-41d7-9709-10cd1326a355 with Priority: HIGHEST for action port [ 2051.950539] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fda7324-e443-41d7-9709-10cd1326a355 with Priority: HIGHEST for action port [ 2051.951022] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fda7324-e443-41d7-9709-10cd1326a355 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.951148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2051.951211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2051.951357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2051.953077] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fda7324-e443-41d7-9709-10cd1326a355',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2052.127396] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: SUCCESS [ 2052.127627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.127784] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.127998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.128207] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.128331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.128397] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.128549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.128671] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.128713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.128803] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2052.374343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.374588] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.374649] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.374895] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.375029] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.375293] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.375407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.375473] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.375631] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.375710] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.375797] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be updated. [ 2052.401065] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.401228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.401302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.401513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.401659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.409539] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: IN_PROGRESS for 2s [ 2052.446540] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2052.447639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.447773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.447948] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f with status ACTIVE [ 2052.448122] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.448231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.448299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.448694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.448694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.448775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.448828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.448880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.449037] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.449135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.449327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.449424] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.449486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.449627] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.449701] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.449841] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88ff3bf8-5f73-470d-bbf4-cb75b1abf94f is going to be updated. [ 2052.453452] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fda7324-e443-41d7-9709-10cd1326a355 with status ACTIVE [ 2052.453611] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.454292] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.454292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.454643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.454643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.454643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.454764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.454804] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.454916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.454989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.455584] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fda7324-e443-41d7-9709-10cd1326a355 is going to be updated. [ 2052.473443] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.473571] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.473642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.473824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.473955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.474161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88ff3bf8-5f73-470d-bbf4-cb75b1abf94f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.478258] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.478379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.478435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.478593] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.478742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.478900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fda7324-e443-41d7-9709-10cd1326a355" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.635156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.635377] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.635508] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.635659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.635894] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.635964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.636050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.636222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.636341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.636438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.636839] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.636839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.636839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.636998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.636998] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2052.637095] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2052.637141] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2052.637275] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2052.637348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.637427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2052.637515] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2052.952552] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2053.140303] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d044933-33d0-42a7-a6bc-f94cca2bad1f: rpc.has_security_group_logging(os_id): False [ 2053.158540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.158711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.158769] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.158986] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.159094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.159318] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.159422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.159485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.159650] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.159728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.159906] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.159999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.160073] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.160220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.160306] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.160493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.160619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.160686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.160811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.160932] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.160932] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f is going to be created. [ 2053.226574] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.226786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.226786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.226967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.227164] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.238028] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: IN_PROGRESS for 2s [ 2053.455539] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.455838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.455918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.456183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.456334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.456503] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be created. [ 2053.478367] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.478594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2053.478594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2053.478715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2053.478872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2053.488133] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: UNINITIALIZED for 2s [ 2053.936284] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a44db054-67f6-416b-8627-f64892f0cf47 in Status: SUCCESS [ 2053.936501] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a44db054-67f6-416b-8627-f64892f0cf47 deletion is rescheduled due to dependency. [ 2053.936633] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2054.419731] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da in Status: SUCCESS [ 2054.420020] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da deletion is rescheduled due to dependency. [ 2054.420020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2055.249496] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: SUCCESS [ 2055.249681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2055.498138] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2055.498437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2055.498688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2055.499031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2055.499331] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2055.499531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2055.499642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2055.499903] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2055.500048] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2055.500201] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2055.500355] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2056.003935] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2056.506031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4da2b7fc-a02b-4823-967f-9cac87b2b905: rpc.has_security_group_logging(os_id): False [ 2056.523687] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2056.523916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2056.523916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2056.524126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2056.524216] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2056.524473] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2056.524578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2056.524642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2056.524975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2056.524975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2056.524975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be created. [ 2056.585871] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2056.586025] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2056.586090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2056.586318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2056.586560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2056.598992] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2056.951297] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2056.951512] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2057.562802] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 2057.563180] env[71051]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e905391a-3582-47f3-bed2-6b326fcbcd5f None None] NSXv3 Agent Agent loop - iteration:3 started [ 2058.329828] env[71051]: INFO networking_nsxv3.common.synchronization [req-b9f6021e-b6c0-4fc8-8b42-89becafac464 req-afa010b4-e8f8-4e8e-871e-73c17ce044e5 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 2058.329828] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9595df2-c77b-4db7-9132-81bb8d4270ae with Priority: HIGHEST for action security_group_members [ 2058.330073] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9595df2-c77b-4db7-9132-81bb8d4270ae taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2058.330137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2058.330646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2058.330646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2058.331217] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2058.331889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2058.331889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2058.331889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2058.332136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2058.332136] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9595df2-c77b-4db7-9132-81bb8d4270ae',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2058.611522] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2058.612038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2058.834922] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2058.835181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2058.835261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2058.835513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2058.835611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2058.835813] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2058.835911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2058.835985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2058.836135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2058.837031] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2058.837031] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae is going to be updated. [ 2058.864286] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2058.864499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2058.864569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2058.864821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2058.865024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2058.873510] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: IN_PROGRESS for 2s [ 2059.117398] env[71051]: INFO networking_nsxv3.common.synchronization [req-faed496e-743a-4486-a496-9c5770a72cb9 req-a6f41ced-18a9-46b8-ac7a-4075063c3db5 tempest-ServerPasswordTestJSON-1668095546 tempest-ServerPasswordTestJSON-1668095546-project-member] Enqueued Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2059.117994] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGHEST for action security_group_members [ 2059.118358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2059.118510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2059.118596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2059.118814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2059.118972] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2059.119245] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2059.119350] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2059.119569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2059.119756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2059.119977] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2059.622757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2059.623122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2059.623122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2059.623212] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2059.623273] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2059.623513] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2059.623619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2059.623676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2059.623837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2059.623917] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2059.624017] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f is going to be updated. [ 2059.673056] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2059.673311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2059.673534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2059.673780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2059.673933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2059.690773] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: IN_PROGRESS for 2s [ 2060.883136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9595df2-c77b-4db7-9132-81bb8d4270ae in Status: SUCCESS [ 2060.883434] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9595df2-c77b-4db7-9132-81bb8d4270ae deletion is rescheduled due to dependency. [ 2060.883434] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9595df2-c77b-4db7-9132-81bb8d4270ae" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2061.701167] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f in Status: SUCCESS [ 2061.701358] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f deletion is rescheduled due to dependency. [ 2061.701474] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2064.118805] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2064.118805] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2066.495915] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2066.496329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2066.496329] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2066.496457] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2066.496514] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2066.999085] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2067.501329] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2068.003847] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2068.004032] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2068.704483] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.704803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.704803] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.704980] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.716620] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2068.717550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.718684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2068.754496] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.754653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.754737] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.754957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.767184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.767993] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2068.768088] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2068.768254] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2068.802286] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.802431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.802548] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.802696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.803755] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.803931] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2068.873573] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.873738] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.874110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.874110] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.874307] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.874564] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2068.950349] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.950511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.950582] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.950789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.951092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.951415] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 2068.951470] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81', 'c1569210-7f11-407a-992e-cc729f87d941', 'cbb6d1cf-c327-4448-b44d-5e5de4b300da', '6c546a99-cc70-447b-86d7-8f2c7bf60dc8', '2340689e-da3e-4aee-87d6-1ef7d8ca959e', '5fbed01f-5a92-4b01-a2c0-374a5bd0301a', '806528ce-4973-42fd-b251-c3e1d4458d10', 'f5eb464e-e67c-4198-8c57-fbece9dc1535', 'a44db054-67f6-416b-8627-f64892f0cf47', 'cc7a55e9-4711-4eed-99ed-cbe058c106cc', '896db215-283f-4c81-b855-943659d9edda', '29c8230f-81e9-43ef-8adc-85278751b6d7', '459311b7-7a4a-42e2-a893-f7e671e0dc28', '9d044933-33d0-42a7-a6bc-f94cca2bad1f', 'b02920d4-bbc8-495c-8ae5-4c754953cd14', '2a108bbd-57c6-4674-a8d2-f5fb8f89af0d', 'd44ee8ef-f57d-42d4-b308-e057c9153016', '3d06bf6c-ef7f-42d0-911f-d260f48bffe2', '7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b', '4da2b7fc-a02b-4823-967f-9cac87b2b905', 'e9595df2-c77b-4db7-9132-81bb8d4270ae', '3bba870c-b5d9-4661-a3d0-55e05367a8db', '16d596f8-78af-47cb-8580-3aab27bce04e', '371c9558-8dd8-4739-882d-f7fbf1f26c54', '5c611102-ef9e-4425-9ced-e6be888b77ae', 'df9ad0e2-035b-4633-b1f0-56f049ff846d', 'e2469f80-4eb1-4a87-9a72-0d981b145113', 'dd2b78d5-f56c-47e2-a26e-d87bff454fb0', 'abff08ff-fc06-4dbe-a011-a141e9aba9d4', '6235e93c-519f-43a7-8c8b-5c8b7d56575b', 'e4e569e0-1641-4c92-94b3-6745ffb49070', 'a48a7216-9768-452e-a3d9-cf477a05890c', '9cf609a9-a0fd-4fd9-894c-95d77014571a', '9efbdb84-0e00-421d-96e9-16064575b3b4', 'e4ca1388-21b4-449b-a002-937897e090a9', '88000fa0-ad41-4e33-a474-dbc4d09cd427', '69614980-875b-4e36-baa7-f93b8253813b', '61b3ef5c-fe30-4fa8-843f-b800b5921066', 'e9288720-d9f6-45b7-9a58-f770ce25595f', '1bbb30ff-0400-4ec6-ade0-aa4c2a91880b', '7f2493d4-27de-4333-a7cd-5237d967e052', '764cf243-3a8f-4abc-8bb0-1036c78cc82c'} {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2068.951579] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2068.970223] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2068.970362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2068.970430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2068.970621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2068.970706] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2068.970807] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2068.970879] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2068.970947] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2069.049053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.049297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.049441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.049777] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.051643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.052069] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2069.052210] env[71051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71051) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2069.052336] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2069.052456] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2069.052598] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 2069.052768] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGH for action security_group_rules [ 2069.052899] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGH for action security_group_rules [ 2069.053058] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGH for action security_group_rules [ 2069.053196] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 2069.053331] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGH for action security_group_rules [ 2069.053461] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGH for action security_group_rules [ 2069.053579] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGH for action security_group_rules [ 2069.053700] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGH for action security_group_rules [ 2069.053825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGH for action security_group_rules [ 2069.053957] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGH for action security_group_rules [ 2069.054107] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGH for action security_group_rules [ 2069.054240] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 2069.054370] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGH for action security_group_rules [ 2069.054486] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGH for action security_group_rules [ 2069.054596] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGH for action security_group_rules [ 2069.054713] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGH for action security_group_rules [ 2069.054844] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGH for action security_group_rules [ 2069.055049] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGH for action security_group_rules [ 2069.055124] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGH for action security_group_rules [ 2069.055222] env[71051]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGH for action security_group_rules [ 2069.055398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.117406] env[71051]: INFO networking_nsxv3.common.synchronization [req-9b1b4871-c400-4043-a3e5-54f3a99a0719 req-fffe49dc-3fb0-4418-9622-1b315546dd39 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2069.117943] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2069.118111] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 with Priority: HIGH for action security_group_rules [ 2069.118217] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da with Priority: HIGH for action security_group_rules [ 2069.118316] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806528ce-4973-42fd-b251-c3e1d4458d10 with Priority: HIGH for action security_group_rules [ 2069.118412] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGH for action security_group_rules [ 2069.118504] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGH for action security_group_rules [ 2069.118630] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b with Priority: HIGH for action security_group_rules [ 2069.118742] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 with Priority: HIGH for action security_group_rules [ 2069.118785] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ee8ef-f57d-42d4-b308-e057c9153016 with Priority: HIGH for action security_group_rules [ 2069.118851] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f with Priority: HIGH for action security_group_rules [ 2069.118938] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d with Priority: HIGH for action security_group_rules [ 2069.119673] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 with Priority: HIGH for action security_group_rules [ 2069.119878] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 with Priority: HIGH for action security_group_rules [ 2069.119991] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896db215-283f-4c81-b855-943659d9edda with Priority: HIGH for action security_group_rules [ 2069.120106] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc with Priority: HIGH for action security_group_rules [ 2069.120200] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44db054-67f6-416b-8627-f64892f0cf47 with Priority: HIGH for action security_group_rules [ 2069.120292] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a with Priority: HIGH for action security_group_rules [ 2069.120382] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 with Priority: HIGH for action security_group_rules [ 2069.120470] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGH for action security_group_rules [ 2069.120633] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1569210-7f11-407a-992e-cc729f87d941 with Priority: HIGH for action security_group_rules [ 2069.120672] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 with Priority: HIGH for action security_group_rules [ 2069.120986] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.121133] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.121199] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.121428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.121617] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.121686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.122010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.122196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.122288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.122383] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.123528] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.123528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.123750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.123818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.123885] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.125515] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.125515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.125515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.125729] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.125729] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbb6d1cf-c327-4448-b44d-5e5de4b300da',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.126715] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806528ce-4973-42fd-b251-c3e1d4458d10 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.126822] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.126893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.127054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.127127] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806528ce-4973-42fd-b251-c3e1d4458d10',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.130062] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.130062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.130062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.130062] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.130062] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.130062] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.130522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.130522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.130522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.130522] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.131168] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.131276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.131341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.131489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.131563] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.132392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.132499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.132565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.132716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.132787] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d06bf6c-ef7f-42d0-911f-d260f48bffe2',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.133478] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44ee8ef-f57d-42d4-b308-e057c9153016 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.133606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.133655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.133801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.133900] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44ee8ef-f57d-42d4-b308-e057c9153016',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.135021] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.135123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.135173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.135317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.135387] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d044933-33d0-42a7-a6bc-f94cca2bad1f',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.136326] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.136326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.136439] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.136510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.136568] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a108bbd-57c6-4674-a8d2-f5fb8f89af0d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.137297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-459311b7-7a4a-42e2-a893-f7e671e0dc28 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.137405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.137470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.137615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.137733] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('459311b7-7a4a-42e2-a893-f7e671e0dc28',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.138629] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c8230f-81e9-43ef-8adc-85278751b6d7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.138757] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.138809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.139024] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.139024] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c8230f-81e9-43ef-8adc-85278751b6d7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.139658] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-896db215-283f-4c81-b855-943659d9edda taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.139767] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.139824] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.140096] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.140096] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('896db215-283f-4c81-b855-943659d9edda',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.140811] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.140913] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.140969] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.141127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.141201] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7a55e9-4711-4eed-99ed-cbe058c106cc',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.141854] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a44db054-67f6-416b-8627-f64892f0cf47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.141959] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.142198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.142198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.142274] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a44db054-67f6-416b-8627-f64892f0cf47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.142896] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.143011] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.143082] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.143231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.143305] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fbed01f-5a92-4b01-a2c0-374a5bd0301a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.144055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5eb464e-e67c-4198-8c57-fbece9dc1535 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.144209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.144414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.145184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.145344] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5eb464e-e67c-4198-8c57-fbece9dc1535',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.146020] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.146137] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.146188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.146448] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.146520] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.147248] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1569210-7f11-407a-992e-cc729f87d941 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.147362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.147480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.147577] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.147681] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1569210-7f11-407a-992e-cc729f87d941',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.148454] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.148553] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.148623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.148920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.148920] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c546a99-cc70-447b-86d7-8f2c7bf60dc8',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.152617] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.404982] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.405233] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.405367] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.405924] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.406119] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.406296] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.406454] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.406684] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.406843] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.407074] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2069.407198] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2069.407313] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2069.407427] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2069.407541] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2069.407652] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2069.407793] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2069.425256] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2069.425424] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2069.425613] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2069.425790] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.426105] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-9c73107d-6e8c-4d41-ae72-598081d551e7 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.426286] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.426414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.426749] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.426908] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c73107d-6e8c-4d41-ae72-598081d551e7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.657999] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.658244] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.658357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.658638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.659123] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.659123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.659220] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.659413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.659544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.659719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.659825] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.661430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.661430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.666140] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.666384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.666483] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.667680] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.667680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.668224] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.677565] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.689926] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.707461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.707794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.707794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.709134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.714384] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.714520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.724568] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.724682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.725471] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.725612] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.726843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.726843] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.729685] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.729775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.730514] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.730613] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.731366] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.731494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.732439] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.732533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.736380] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.736563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.737252] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.737384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.737958] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.738379] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.738478] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.739171] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.739603] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.739714] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.740424] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.740893] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.741016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.741812] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.742262] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.742383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.743332] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.743751] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.743865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.744495] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.744889] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.745014] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.745706] env[71051]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2069.746177] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.746303] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 459311b7-7a4a-42e2-a893-f7e671e0dc28 is going to be deleted. [ 2069.747289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.747493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.763621] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.763739] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1569210-7f11-407a-992e-cc729f87d941 is going to be deleted. [ 2069.764580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.764880] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.779371] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.779513] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5eb464e-e67c-4198-8c57-fbece9dc1535 is going to be deleted. [ 2069.780477] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.780680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.797271] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.797446] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.798500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.799183] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d044933-33d0-42a7-a6bc-f94cca2bad1f is going to be deleted. [ 2069.799468] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.799676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.816405] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.816405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.818776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.818776] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c546a99-cc70-447b-86d7-8f2c7bf60dc8 is going to be deleted. [ 2069.819912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.819912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.839045] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.839166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.855716] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.855851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.859590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.859699] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fbed01f-5a92-4b01-a2c0-374a5bd0301a is going to be deleted. [ 2069.860572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.860780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.868353] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.868484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.899697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.900085] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbb6d1cf-c327-4448-b44d-5e5de4b300da is going to be deleted. [ 2069.900741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.900950] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.930364] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.930364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.930364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.930364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.930364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.930364] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 9c73107d-6e8c-4d41-ae72-598081d551e7 not found, creating... [ 2069.930364] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.930364] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.930861] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.930861] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.930861] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.931048] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.931213] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.931337] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.931552] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.931694] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.931841] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 9c73107d-6e8c-4d41-ae72-598081d551e7 is going to be created. [ 2069.933551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.933727] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81 is going to be deleted. [ 2069.934500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.934663] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.957704] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.957846] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44ee8ef-f57d-42d4-b308-e057c9153016 is going to be deleted. [ 2069.958677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.958872] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.960569] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.960785] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2069.960893] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2069.961131] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2069.961354] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2069.961563] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.023094] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.023257] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.034598] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.034726] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.035142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.035255] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 896db215-283f-4c81-b855-943659d9edda is going to be deleted. [ 2070.036211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.036419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.038284] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.038394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.094113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.094263] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a44db054-67f6-416b-8627-f64892f0cf47 is going to be deleted. [ 2070.095202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.095421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.139727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.139874] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.163337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.163487] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d06bf6c-ef7f-42d0-911f-d260f48bffe2 is going to be deleted. [ 2070.164516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.164731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.181609] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2070.190725] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.190918] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.190989] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.191230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.191326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.191430] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2070.195907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.196035] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c8230f-81e9-43ef-8adc-85278751b6d7 is going to be deleted. [ 2070.196891] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2340689e-da3e-4aee-87d6-1ef7d8ca959e: rpc.has_security_group_logging(os_id): False [ 2070.197651] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.197850] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.236493] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.236645] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.240327] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.240443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.241069] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.241166] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.254766] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.254875] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7a55e9-4711-4eed-99ed-cbe058c106cc is going to be deleted. [ 2070.255798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.255996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.292922] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.292922] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806528ce-4973-42fd-b251-c3e1d4458d10 is going to be deleted. [ 2070.293851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.294059] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.303922] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.304077] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.304128] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.304305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.304466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.317985] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2070.331825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.331948] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a108bbd-57c6-4674-a8d2-f5fb8f89af0d is going to be deleted. [ 2070.332761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.332961] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.337931] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.338063] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.369470] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.369787] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.371558] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.371659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.395235] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.395373] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b is going to be deleted. [ 2070.397052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.397052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.397052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.397052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-459311b7-7a4a-42e2-a893-f7e671e0dc28" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.397052] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.397254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.397254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.397403] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1569210-7f11-407a-992e-cc729f87d941" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.397882] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.398094] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.398203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.398261] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5eb464e-e67c-4198-8c57-fbece9dc1535" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.398390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.398529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.398604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.398715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d044933-33d0-42a7-a6bc-f94cca2bad1f" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.398910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.399098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.399230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.399409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c546a99-cc70-447b-86d7-8f2c7bf60dc8" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.399608] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.399785] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.399862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.399979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fbed01f-5a92-4b01-a2c0-374a5bd0301a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.400308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.400308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.400308] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.400603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbb6d1cf-c327-4448-b44d-5e5de4b300da" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.400603] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.400670] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.400750] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.400810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b7d561-0aaf-45e5-9b0c-b14b17b3cd81" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.400929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.401086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.401160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.401260] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44ee8ef-f57d-42d4-b308-e057c9153016" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.401394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.401519] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.432219] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.432393] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.446445] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.446874] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.446982] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.447066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.447281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.447348] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.447447] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2070.448472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.448639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.448725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.448844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-896db215-283f-4c81-b855-943659d9edda" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.448971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.449135] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.449264] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.449321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a44db054-67f6-416b-8627-f64892f0cf47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.449460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.449599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.449693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.449809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c8230f-81e9-43ef-8adc-85278751b6d7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.449925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.450089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.450182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.450289] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d06bf6c-ef7f-42d0-911f-d260f48bffe2" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.450818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.450972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.451065] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.451173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7a55e9-4711-4eed-99ed-cbe058c106cc" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.451287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.451426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.451500] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.451610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806528ce-4973-42fd-b251-c3e1d4458d10" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.526569] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.526569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.526728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.526875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.526968] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.527093] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a108bbd-57c6-4674-a8d2-f5fb8f89af0d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.529368] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.529516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.529561] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.529773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.529862] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.529975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7394cdf2-148d-4a1d-9e2e-bd5380ad9a7b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.626524] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.626728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.626845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.627045] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.627195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.666751] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2070.684213] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b02920d4-bbc8-495c-8ae5-4c754953cd14: rpc.has_security_group_logging(os_id): False [ 2070.720195] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.720544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.720544] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.720682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.758594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.758928] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.759091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.759160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.759398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.759485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.759587] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2070.825190] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.825342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.825406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.825640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.825783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.834077] env[71051]: INFO networking_nsxv3.common.synchronization [req-9b1b4871-c400-4043-a3e5-54f3a99a0719 req-a0611e61-82c7-45ea-b256-8e5d82ee9748 service nova] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2070.834292] env[71051]: INFO networking_nsxv3.common.synchronization [req-9b1b4871-c400-4043-a3e5-54f3a99a0719 req-a0611e61-82c7-45ea-b256-8e5d82ee9748 service nova] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2070.834439] env[71051]: INFO networking_nsxv3.common.synchronization [req-9b1b4871-c400-4043-a3e5-54f3a99a0719 req-a0611e61-82c7-45ea-b256-8e5d82ee9748 service nova] Enqueued Resource ID: 9c73107d-6e8c-4d41-ae72-598081d551e7 with Priority: HIGHEST for action port [ 2070.834704] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_rules [ 2070.834836] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2070.834937] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c73107d-6e8c-4d41-ae72-598081d551e7 with Priority: HIGHEST for action port [ 2070.835540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.835630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.835806] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.835915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.836079] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c73107d-6e8c-4d41-ae72-598081d551e7 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.836183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.836236] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.836414] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.836494] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c73107d-6e8c-4d41-ae72-598081d551e7',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2070.838030] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2071.339677] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c73107d-6e8c-4d41-ae72-598081d551e7 with status ACTIVE [ 2071.339911] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.340072] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.340143] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.340359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.340452] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.340634] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.340731] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.340792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.340937] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.341026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.341208] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.341302] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.341361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.341497] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.341569] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.341654] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c73107d-6e8c-4d41-ae72-598081d551e7 is going to be updated. [ 2071.361129] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.361129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.361129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.361129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.361129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.361370] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c73107d-6e8c-4d41-ae72-598081d551e7" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.326040] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2072.326428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.326428] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2072.326518] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2072.326775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2072.326891] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2072.326967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2072.327211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2072.327386] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.327444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.327549] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2072.328456] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2072.328653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2072.328841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2072.328970] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2072.329068] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2072.329239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2072.329340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.329446] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2072.677863] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2072.678206] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2072.830870] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2072.831898] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2072.849720] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2072.849942] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.334963] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4da2b7fc-a02b-4823-967f-9cac87b2b905: rpc.has_security_group_logging(os_id): False [ 2073.336193] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2073.355064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.355203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2073.355272] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2073.355470] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2073.372036] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.372322] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.372432] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2073.372493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2073.372676] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2073.373323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.373323] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2073.440297] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.440506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2073.440506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2073.440705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2073.440856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.451872] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2073.839029] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.839379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2073.839379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2073.839379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2073.839492] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.839525] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2073.866726] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.866962] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2073.867060] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2073.867283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2073.867429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2073.875397] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2075.465445] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2075.465876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.465934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.466190] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.466314] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2075.581383] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d056c89-8918-47f0-8d50-8d142595e183 req-da3383cf-bbd7-49a4-ab81-de2114ae39a2 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2075.581913] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2075.582230] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.582354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.582431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.582626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.582775] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.582873] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.582934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.583176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.583265] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.583359] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2075.870361] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.870776] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.870776] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.871017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.871318] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.871487] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.871635] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.871935] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.872133] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.872352] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2075.872474] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2075.872588] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2075.872754] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2075.872894] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2075.873023] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2075.873168] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2075.883237] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2075.883450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.891574] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2075.891782] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2075.891935] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2075.892125] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-395" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.892430] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.892604] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.892727] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.893064] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.893214] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2075.969018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.969018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.969018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.969018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.969018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.969341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.969341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.969341] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.969442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.969479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.969572] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2076.085719] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2076.395443] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.395802] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.395971] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.396452] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.396671] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.396901] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb not found, creating... [ 2076.397234] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.397407] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.397533] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.397772] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.397918] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.398249] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.398849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.398849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.398849] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.398998] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.399060] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb is going to be created. [ 2076.418525] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.418752] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.418888] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.419182] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.419444] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.419675] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.471454] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2076.587898] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2076.973388] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4da2b7fc-a02b-4823-967f-9cac87b2b905: rpc.has_security_group_logging(os_id): False [ 2076.990211] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.990410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.990410] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.990642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.990741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.991010] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.991125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.991186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.991345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.991421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.991511] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2077.064684] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.064858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.064907] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.065120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.065267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.077636] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2077.090204] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.090390] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.090486] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.090741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.090889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.091071] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2077.110141] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d056c89-8918-47f0-8d50-8d142595e183 req-35aac03c-4bbe-4503-86a7-8c35cb4ebc9c service nova] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 2077.110327] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d056c89-8918-47f0-8d50-8d142595e183 req-35aac03c-4bbe-4503-86a7-8c35cb4ebc9c service nova] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2077.110474] env[71051]: INFO networking_nsxv3.common.synchronization [req-3d056c89-8918-47f0-8d50-8d142595e183 req-35aac03c-4bbe-4503-86a7-8c35cb4ebc9c service nova] Enqueued Resource ID: c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb with Priority: HIGHEST for action port [ 2077.110696] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_rules [ 2077.110825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2077.110940] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb with Priority: HIGHEST for action port [ 2077.111555] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.111709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.111798] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.112010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.112109] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2077.113398] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.113515] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.113757] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.113860] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.113971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.114126] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.114241] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2077.122388] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.122510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.122578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.122762] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.123017] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.131742] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2077.615516] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.615848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.615893] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb with status ACTIVE [ 2077.616080] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.616195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.616262] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.616517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.616617] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.616801] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.616945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.617028] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.617205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.617286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.617526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.617655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.617697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.617876] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.617934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.618044] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb is going to be updated. [ 2077.639050] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2077.639227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2077.639227] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2077.639409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2077.639539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2077.639716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5d7847d-aa7a-4858-9362-c2cf6ec7d8bb" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2078.508991] env[71051]: INFO networking_nsxv3.common.synchronization [None req-0419cf00-45d7-4491-a3e7-7536fb846ea5 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2078.509560] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2078.509862] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.510041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2078.510155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2078.510435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2078.510669] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.510841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2078.510935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2078.514585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2078.514686] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2078.514787] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.017863] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.018231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2079.018231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2079.018333] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2079.018425] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.018617] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.018812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2079.018812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2079.018924] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2079.018975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.019081] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be deleted. [ 2079.045301] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.045449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2079.045506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2079.045724] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2079.045853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.045958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.089799] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2079.090035] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.141038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2079.141038] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.141283] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2079.141929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2079.141929] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.141929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2079.141929] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2079.142193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2079.142193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2079.142271] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.645060] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2080.149159] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2080.651343] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.651549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2080.651549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2080.651741] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2080.651838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2080.651945] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2080.679140] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.679369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2080.679369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2080.679572] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2080.679721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2080.691904] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2082.702193] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2082.702554] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.702599] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.702783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.702972] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.703697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.703838] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.703996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.704123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.704219] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.704312] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.207225] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.511816] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2083.511992] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2083.709969] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b02920d4-bbc8-495c-8ae5-4c754953cd14: rpc.has_security_group_logging(os_id): False [ 2083.730810] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.731057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.731057] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.731254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.731351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.731624] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.731707] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.731749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.731900] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.731977] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.732190] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2083.785323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.785534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.785534] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.785789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.786098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.799931] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2084.915282] env[71051]: INFO networking_nsxv3.common.synchronization [req-e42ef10d-cda4-4c3a-b725-f2da0e348bdb req-4967fe1a-b040-42b9-8f12-c79502f37a3a tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2084.915794] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca1388-21b4-449b-a002-937897e090a9 with Priority: HIGHEST for action security_group_members [ 2084.916742] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca1388-21b4-449b-a002-937897e090a9 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2084.916742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2084.916742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2084.916742] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2084.916742] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2084.917044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2084.917044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2084.917044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2084.917146] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2084.917450] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca1388-21b4-449b-a002-937897e090a9',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2085.420314] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2085.420314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2085.420314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2085.420314] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2085.441851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2085.443023] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2085.443023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2085.443023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2085.443023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2085.443023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2085.443023] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca1388-21b4-449b-a002-937897e090a9 is going to be updated. [ 2085.481165] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2085.481359] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2085.481413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2085.481659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2085.481828] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2085.490419] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: IN_PROGRESS for 2s [ 2085.815240] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2085.815501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2087.500659] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca1388-21b4-449b-a002-937897e090a9 in Status: SUCCESS [ 2087.500659] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca1388-21b4-449b-a002-937897e090a9 deletion is rescheduled due to dependency. [ 2087.500659] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca1388-21b4-449b-a002-937897e090a9" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2089.917058] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2089.917451] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2093.081469] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.081850] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.081850] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.082088] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.082357] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.082520] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.082641] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.082861] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.083022] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.083238] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2093.083357] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2093.083504] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2093.083678] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2093.083804] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2093.083917] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2093.084085] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2093.105695] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2093.105900] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2093.106009] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2093.106255] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.106559] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2800b255-adeb-4867-bb34-ac40b9177c2b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.106734] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.106860] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.107266] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.107426] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2800b255-adeb-4867-bb34-ac40b9177c2b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2093.610148] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.610389] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.610525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.610816] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.610977] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.611159] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2800b255-adeb-4867-bb34-ac40b9177c2b not found, creating... [ 2093.611425] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.611591] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.611716] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.611938] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.612097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.612395] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.612558] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.612681] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.612890] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.613045] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.613194] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2800b255-adeb-4867-bb34-ac40b9177c2b is going to be created. [ 2093.632077] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2093.632285] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2093.632407] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2093.632631] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2093.632852] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2093.633259] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.306402] env[71051]: INFO networking_nsxv3.common.synchronization [req-9350d609-42f2-40f6-8e60-20d73925877f req-4eb65b2d-cfb7-4287-8b64-6c53957ff151 service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 2094.306694] env[71051]: INFO networking_nsxv3.common.synchronization [req-9350d609-42f2-40f6-8e60-20d73925877f req-4eb65b2d-cfb7-4287-8b64-6c53957ff151 service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2094.306733] env[71051]: INFO networking_nsxv3.common.synchronization [req-9350d609-42f2-40f6-8e60-20d73925877f req-4eb65b2d-cfb7-4287-8b64-6c53957ff151 service nova] Enqueued Resource ID: 2800b255-adeb-4867-bb34-ac40b9177c2b with Priority: HIGHEST for action port [ 2094.306966] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 2094.307128] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2094.307240] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2800b255-adeb-4867-bb34-ac40b9177c2b with Priority: HIGHEST for action port [ 2094.307827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.307928] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.307992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.308485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.308485] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2094.309055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.309285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.309285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.309489] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.309593] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.309692] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.309752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.309888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.309972] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.310071] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2094.310804] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2800b255-adeb-4867-bb34-ac40b9177c2b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.311067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.311067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.311330] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.311330] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2800b255-adeb-4867-bb34-ac40b9177c2b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2094.814184] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.814184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.814184] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2094.814509] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2800b255-adeb-4867-bb34-ac40b9177c2b with status ACTIVE [ 2094.814709] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.814877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.814995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.815228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.815315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.815496] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.815611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.815677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.815792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.815868] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.816053] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.816208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.816269] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.816405] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.816481] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.816583] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2800b255-adeb-4867-bb34-ac40b9177c2b is going to be updated. [ 2094.839812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2094.840013] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2094.840107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2094.840286] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2094.840421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2094.840579] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2095.318520] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2095.822304] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2095.822304] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2095.822422] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2095.822642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2095.822642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2095.822753] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be created. [ 2095.834648] env[71051]: INFO networking_nsxv3.common.synchronization [req-74cc28d5-651e-4a97-987b-1a426a83e485 req-f81593da-8527-4f25-adc6-134f5863aa48 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 2095.835232] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a with Priority: HIGHEST for action security_group_members [ 2095.835540] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cf609a9-a0fd-4fd9-894c-95d77014571a taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2095.835661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2095.835728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2095.835920] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2095.836427] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2095.836541] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2095.836628] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2095.837222] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2095.837324] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2095.837433] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cf609a9-a0fd-4fd9-894c-95d77014571a',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2095.846057] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2095.846230] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2095.846281] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2095.846535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2095.846598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2095.855358] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: UNINITIALIZED for 2s [ 2096.340028] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2096.340364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2096.340364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2096.340516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2096.360810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2096.361071] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2096.361198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2096.361267] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2096.361462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2096.361546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2096.361640] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a is going to be updated. [ 2096.387482] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2096.387632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2096.387713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2096.387892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2096.387999] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2096.397912] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: IN_PROGRESS for 2s [ 2097.420793] env[71051]: INFO networking_nsxv3.common.synchronization [req-dd1881ed-6e96-4982-b25a-6274be16ebfe req-2f2d9dbe-e19b-4f69-8a61-65103d38f640 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2097.421344] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2097.421641] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.421763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.421829] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.422027] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.422743] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.422743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.422743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.422743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.422743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.422743] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2097.866061] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.866061] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.866061] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.866531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.866531] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.866531] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2097.924950] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.925159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.925208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.925430] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.925536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.925834] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.925952] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.926021] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.926225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.926310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.926401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2097.956323] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2097.956576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2097.956576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2097.956728] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2097.956881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2097.965461] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2098.368521] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.368720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.368789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.369010] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.369192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.369292] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.369354] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.369542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.369594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.369678] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.369821] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.369915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.369975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.370127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.370263] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.370356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.370417] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.370552] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.370626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.370705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.370793] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2098.407954] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a in Status: SUCCESS [ 2098.408155] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cf609a9-a0fd-4fd9-894c-95d77014571a deletion is rescheduled due to dependency. [ 2098.408271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cf609a9-a0fd-4fd9-894c-95d77014571a" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.872884] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59190f66-54f4-449e-a67c-42ef58b0914d: rpc.has_security_group_logging(os_id): False [ 2098.890430] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.890586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.890640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.890851] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.890941] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.891152] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.891250] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.891309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.891467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.891546] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.891744] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.891837] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.891902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.892054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.892129] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.892312] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.892512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.892512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.892596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.892679] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.892740] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be created. [ 2098.947308] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2098.947527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2098.947527] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2098.947657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2098.947834] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2098.957272] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 2099.975929] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2099.976347] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e deletion is rescheduled due to dependency. [ 2099.976347] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2100.307826] env[71051]: INFO networking_nsxv3.common.synchronization [None req-456a06b8-0eef-4014-87a7-754ca2f969b0 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2100.308439] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2100.308733] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2100.308859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2100.308925] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2100.309188] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2100.309275] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2100.371948] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fc28c075-5026-4d69-96c5-ec8bec33f142 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2100.372430] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2100.372914] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2100.372914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2100.827521] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2100.827976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2100.827976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2100.827976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2100.828181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2100.828181] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 already deleted. [ 2100.828357] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2100.828400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2100.828638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2100.828743] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2100.967456] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 2100.967677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2101.347773] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2101.348111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2101.348111] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2101.348214] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2101.348303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2101.348401] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 already deleted. [ 2101.348480] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.276452] env[71051]: INFO networking_nsxv3.common.synchronization [req-fd93e711-3332-4acd-b44c-402f31e090dc req-3b196f81-2b06-4035-9120-beb5c7bf2497 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2104.276452] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2104.276761] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.276761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.276761] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.276902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.277267] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.277421] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.277503] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.277698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.277790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.277886] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2104.595451] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.595668] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.595799] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.596092] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.596399] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.596569] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.596693] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.598891] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.599188] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.599432] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2104.599559] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2104.599682] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2104.599794] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2104.599904] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2104.600039] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2104.600189] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2104.621261] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2104.621421] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2104.621573] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2104.621736] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.622045] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-af25e492-11ca-4c71-9082-c271bf151d7c taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.622221] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.622346] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.622652] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.622795] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af25e492-11ca-4c71-9082-c271bf151d7c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2104.780182] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.780491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.780491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.780715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.780715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.780904] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.780998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.781078] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.781217] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.781293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.781378] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2104.807729] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2104.807927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2104.807927] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2104.808084] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2104.808223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2104.816555] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2105.125398] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.125642] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.125770] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.126082] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.126244] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2105.126439] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port af25e492-11ca-4c71-9082-c271bf151d7c not found, creating... [ 2105.126709] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.126876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.127008] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.127245] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.127422] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2105.127751] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.127920] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.128059] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.128279] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.128420] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2105.128569] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: af25e492-11ca-4c71-9082-c271bf151d7c is going to be created. [ 2105.149277] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.149501] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.149598] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.149820] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.150060] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2105.150286] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2105.816204] env[71051]: INFO networking_nsxv3.common.synchronization [req-fd93e711-3332-4acd-b44c-402f31e090dc req-e8a03456-884c-4a60-8fb0-93fa18123fa2 service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 2105.816533] env[71051]: INFO networking_nsxv3.common.synchronization [req-fd93e711-3332-4acd-b44c-402f31e090dc req-e8a03456-884c-4a60-8fb0-93fa18123fa2 service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2105.816639] env[71051]: INFO networking_nsxv3.common.synchronization [req-fd93e711-3332-4acd-b44c-402f31e090dc req-e8a03456-884c-4a60-8fb0-93fa18123fa2 service nova] Enqueued Resource ID: af25e492-11ca-4c71-9082-c271bf151d7c with Priority: HIGHEST for action port [ 2105.816919] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 2105.817067] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2105.817170] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af25e492-11ca-4c71-9082-c271bf151d7c with Priority: HIGHEST for action port [ 2105.817712] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.817841] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.817906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.818120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.818206] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2105.819014] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.819113] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.819305] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-af25e492-11ca-4c71-9082-c271bf151d7c taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2105.819402] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2105.819479] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2105.819700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2105.819755] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af25e492-11ca-4c71-9082-c271bf151d7c',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2106.321994] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.322180] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.322396] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af25e492-11ca-4c71-9082-c271bf151d7c with status ACTIVE [ 2106.322580] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.322695] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.322759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.322974] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.323123] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.323255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.323351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.323426] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.323562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.323639] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.323817] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.323910] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.323963] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.324127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.324193] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.324299] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af25e492-11ca-4c71-9082-c271bf151d7c is going to be updated. [ 2106.346206] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.346441] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.346516] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.346735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.346889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.347089] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af25e492-11ca-4c71-9082-c271bf151d7c" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.536420] env[71051]: INFO networking_nsxv3.common.synchronization [req-61796ca4-e804-49f4-a2ad-ca6466949300 req-f5298e2d-406e-4d31-8709-292fdbb7c6a8 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2106.536953] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2106.537295] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.537467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.537533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.537763] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.537917] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.538638] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.538712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.538926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.539043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.539142] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2106.820801] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.821120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.821163] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.821414] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.821692] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.821858] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.822017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.822242] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.822398] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.822614] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2106.822737] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2106.822859] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2106.822970] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2106.823103] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2106.823216] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2106.823359] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2106.831079] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2106.831240] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e deletion is rescheduled due to dependency. [ 2106.831342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.831708] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.831871] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.832033] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.832134] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.832196] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.832335] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.832415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.832506] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2106.846921] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2106.847115] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2106.847283] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2106.847467] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2106.847737] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-5cf6b208-5e95-429f-a576-7e2e890afb47 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2106.847901] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2106.848038] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2106.848326] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2106.848472] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf6b208-5e95-429f-a576-7e2e890afb47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2107.041980] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.042173] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.042328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.042460] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.042576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.042789] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.042911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.042953] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.043125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.043205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.043292] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 already deleted. [ 2107.043372] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.334337] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2107.349946] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.350193] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.350331] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.350612] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.350775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.350936] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 5cf6b208-5e95-429f-a576-7e2e890afb47 not found, creating... [ 2107.351223] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.351391] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.351537] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.351771] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.351918] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.352224] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.352389] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.352517] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.352735] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.352880] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.353038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 5cf6b208-5e95-429f-a576-7e2e890afb47 is going to be created. [ 2107.372456] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2107.372706] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2107.372856] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2107.373115] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2107.373343] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.373568] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2107.836420] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2108.339018] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.339202] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.339271] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.339458] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.339542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.339637] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2108.364975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.365189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.365189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.365382] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.365529] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.372917] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2108.449188] env[71051]: INFO networking_nsxv3.common.synchronization [req-61796ca4-e804-49f4-a2ad-ca6466949300 req-8ee3bfba-89c5-47f4-a720-8efaaab3c2d7 service nova] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2108.449387] env[71051]: INFO networking_nsxv3.common.synchronization [req-61796ca4-e804-49f4-a2ad-ca6466949300 req-8ee3bfba-89c5-47f4-a720-8efaaab3c2d7 service nova] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2108.449550] env[71051]: INFO networking_nsxv3.common.synchronization [req-61796ca4-e804-49f4-a2ad-ca6466949300 req-8ee3bfba-89c5-47f4-a720-8efaaab3c2d7 service nova] Enqueued Resource ID: 5cf6b208-5e95-429f-a576-7e2e890afb47 with Priority: HIGHEST for action port [ 2108.449789] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_rules [ 2108.449918] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2108.450024] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cf6b208-5e95-429f-a576-7e2e890afb47 with Priority: HIGHEST for action port [ 2108.450571] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.450703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.450778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.450960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.451058] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2108.451827] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.451960] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.451998] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.454419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.454419] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.454419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.454419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.454419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.454419] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.454419] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2108.455024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cf6b208-5e95-429f-a576-7e2e890afb47 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.455131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.455131] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.456153] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.456153] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf6b208-5e95-429f-a576-7e2e890afb47',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2108.957440] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2108.959049] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.959198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.964191] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cf6b208-5e95-429f-a576-7e2e890afb47 with status ACTIVE [ 2108.964191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.964191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.964191] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.964191] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.964870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.964870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.964870] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cf6b208-5e95-429f-a576-7e2e890afb47 is going to be updated. [ 2108.983172] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2108.983318] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2108.983399] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2108.983512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2108.983636] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2108.983778] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cf6b208-5e95-429f-a576-7e2e890afb47" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2109.460707] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2109.966254] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2109.966618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2109.966618] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2109.966825] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2109.966935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2109.967066] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 is going to be created. [ 2109.988618] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2109.988912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2109.988912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2109.989026] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2109.989194] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2109.997258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: UNINITIALIZED for 2s [ 2110.382369] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2110.382744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2110.382995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2110.383229] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2110.383422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2110.383550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2110.383624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2110.383773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2110.383879] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2110.383938] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2110.384053] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2110.705675] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2110.705957] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2110.706185] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2110.706525] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2110.706885] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2110.707120] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2110.707295] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2110.707592] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2110.707800] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2110.708105] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2110.708275] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2110.708439] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2110.708607] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2110.708770] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2110.708935] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2110.709142] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2110.728407] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2110.728613] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2110.728807] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2110.729097] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-251" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2110.729492] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2800b255-adeb-4867-bb34-ac40b9177c2b taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2110.729723] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2110.729898] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2110.730220] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2110.730415] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2800b255-adeb-4867-bb34-ac40b9177c2b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2110.886647] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2111.232771] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.233181] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.233229] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.233524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.233715] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.234061] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.234259] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.234545] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.234843] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.235017] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.235328] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.235497] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.235624] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.235845] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.235991] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.236157] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2800b255-adeb-4867-bb34-ac40b9177c2b is going to be updated. [ 2111.255506] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.255692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.255850] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.256078] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.256272] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.256560] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.388442] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2340689e-da3e-4aee-87d6-1ef7d8ca959e: rpc.has_security_group_logging(os_id): False [ 2111.407843] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.408046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.408104] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.408298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.408394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.408668] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.408801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.408890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.409053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.409203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.409245] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2111.471241] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2111.471241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2111.471241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2111.471241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2111.471241] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2111.485468] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2112.006599] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: SUCCESS [ 2112.006840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.007009] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.007231] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.007419] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.007694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.007694] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.007844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.007844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.007943] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.008036] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.079055] env[71051]: INFO networking_nsxv3.common.synchronization [req-f756a5d0-b561-4527-9222-f5518da17973 req-c184a356-46ee-48cd-a91a-332ed7ce3d01 service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 2112.079264] env[71051]: INFO networking_nsxv3.common.synchronization [req-f756a5d0-b561-4527-9222-f5518da17973 req-c184a356-46ee-48cd-a91a-332ed7ce3d01 service nova] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2112.079410] env[71051]: INFO networking_nsxv3.common.synchronization [req-f756a5d0-b561-4527-9222-f5518da17973 req-c184a356-46ee-48cd-a91a-332ed7ce3d01 service nova] Enqueued Resource ID: 2800b255-adeb-4867-bb34-ac40b9177c2b with Priority: HIGHEST for action port [ 2112.079635] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_rules [ 2112.079825] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2112.079944] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2800b255-adeb-4867-bb34-ac40b9177c2b with Priority: HIGHEST for action port [ 2112.080469] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.080610] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.080664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.080845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.080926] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.081759] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.081889] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.081992] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.082205] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.082356] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.082467] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.082510] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.082725] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.082810] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.082892] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.083639] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2800b255-adeb-4867-bb34-ac40b9177c2b taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.083749] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.083814] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.083997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.084105] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2800b255-adeb-4867-bb34-ac40b9177c2b',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.511039] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.585995] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.586203] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.586568] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2112.587808] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2800b255-adeb-4867-bb34-ac40b9177c2b with status ACTIVE [ 2112.588099] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.588251] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.588376] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.588643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.588975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.589272] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.589431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.589539] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.589792] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.589906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.590168] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.590345] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.590437] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.590598] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.590759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.590881] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2800b255-adeb-4867-bb34-ac40b9177c2b is going to be updated. [ 2112.611782] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2112.612039] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2112.612125] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2112.612438] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2112.612592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2112.612845] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2800b255-adeb-4867-bb34-ac40b9177c2b" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.012942] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a5faa5-1a2a-430d-8c2c-cebc38471410: rpc.has_security_group_logging(os_id): False [ 2113.029626] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2113.029811] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2113.029914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2113.030142] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2113.030233] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.030517] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2113.030624] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2113.030688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2113.030839] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2113.030916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.031016] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 is going to be created. [ 2113.087150] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2113.087400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2113.087400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2113.087567] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2113.087743] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.093323] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2113.097633] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: IN_PROGRESS for 2s [ 2113.499256] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2113.499498] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.595360] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2113.595698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2113.595698] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2113.595818] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2113.595911] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.596038] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be updated. [ 2113.623741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2113.623936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2113.623995] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2113.624172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2113.624310] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2113.632084] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 2115.108549] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: SUCCESS [ 2115.108890] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2115.639989] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 2115.640280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2115.640472] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2115.640711] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2115.640937] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2115.641091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2115.641154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2115.641331] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2115.641415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2115.641501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2115.641614] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2116.144118] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.144566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.144566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.144721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.144772] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.144956] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.145044] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.145204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.145297] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.145385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.145584] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.145709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.145783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.146020] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.146188] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.146317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.146400] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.146596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.146700] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.146801] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.147187] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2116.652020] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59190f66-54f4-449e-a67c-42ef58b0914d: rpc.has_security_group_logging(os_id): False [ 2116.668594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.668783] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.668833] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.669064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.669160] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.669352] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.669455] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.669512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.669677] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.669773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.669991] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.670148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.670228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.670369] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.670442] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.670621] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.670716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.670773] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.670905] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.670978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.671588] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be updated. [ 2116.727389] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2116.727551] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2116.727606] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2116.727830] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2116.727976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2116.739064] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 2117.080850] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2117.081026] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2118.752694] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 2118.753103] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2122.081889] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2122.082250] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2127.082641] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2127.083052] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2127.892774] env[71051]: INFO networking_nsxv3.common.synchronization [req-d1555960-c579-44b0-b11f-404e101d04c3 req-23ce7225-990a-44cb-b3c0-78949e2d735e tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2127.893477] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2127.893805] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2127.893936] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2127.894007] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2127.894362] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2127.894526] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2127.894643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2127.895155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2127.895155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2127.895155] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2127.895155] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2128.397743] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2128.899720] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2129.403119] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2129.403528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2129.403528] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2129.403732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2129.403799] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2129.403870] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2129.434046] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2129.434326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2129.434326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2129.434482] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2129.434642] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2129.443251] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2131.453022] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2131.453407] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2132.894114] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2132.894413] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2134.188596] env[71051]: INFO networking_nsxv3.common.synchronization [req-98bee641-1ea9-4b31-871e-5e4a29271149 req-94b751eb-506c-4402-b92d-19869f71be63 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2134.189174] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 with Priority: HIGHEST for action security_group_members [ 2134.189485] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-4da2b7fc-a02b-4823-967f-9cac87b2b905 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2134.189607] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2134.189696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2134.189859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2134.190015] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2134.190433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2134.190494] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2134.190655] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2134.190740] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2134.190836] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4da2b7fc-a02b-4823-967f-9cac87b2b905',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2134.693064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2134.693064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2134.693064] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2134.693433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2134.693433] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2134.693504] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2134.693601] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2134.693657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2134.693791] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2134.693867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2134.693949] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 is going to be updated. [ 2134.720812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2134.720975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2134.721050] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2134.721181] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2134.721315] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2134.728811] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: IN_PROGRESS for 2s [ 2136.739780] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 in Status: SUCCESS [ 2136.739780] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4da2b7fc-a02b-4823-967f-9cac87b2b905 deletion is rescheduled due to dependency. [ 2136.739780] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4da2b7fc-a02b-4823-967f-9cac87b2b905" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2138.626405] env[71051]: INFO networking_nsxv3.common.synchronization [None req-c4f6e008-8a97-4d71-8d7f-3202c9218228 tempest-AttachInterfacesTestJSON-1066740665 tempest-AttachInterfacesTestJSON-1066740665-project-member] Enqueued Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2138.626749] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59190f66-54f4-449e-a67c-42ef58b0914d with Priority: HIGHEST for action security_group_members [ 2138.626749] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-59190f66-54f4-449e-a67c-42ef58b0914d taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2138.627501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2138.627501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2138.627501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2138.627501] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2138.627501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2138.627501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2138.627794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2138.627794] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2138.627913] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59190f66-54f4-449e-a67c-42ef58b0914d',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2139.130183] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2139.130381] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2139.130450] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2139.130721] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2139.130844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2139.131072] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2139.131211] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2139.131462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2139.131462] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2139.131592] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2139.131638] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d is going to be updated. [ 2139.159440] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2139.159611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2139.159652] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2139.159870] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2139.160042] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2139.168173] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: IN_PROGRESS for 2s [ 2141.178357] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59190f66-54f4-449e-a67c-42ef58b0914d in Status: SUCCESS [ 2141.178644] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59190f66-54f4-449e-a67c-42ef58b0914d deletion is rescheduled due to dependency. [ 2141.178644] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59190f66-54f4-449e-a67c-42ef58b0914d" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2142.267955] env[71051]: INFO networking_nsxv3.common.synchronization [None req-cef6fb7e-00e6-46cf-a59d-31e9178c5c42 None None] Enqueued Resource ID: e9660efe-a420-49cf-9816-be121cd9cd92 with Priority: HIGHEST for action port [ 2142.268348] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9660efe-a420-49cf-9816-be121cd9cd92 with Priority: HIGHEST for action port [ 2142.268632] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9660efe-a420-49cf-9816-be121cd9cd92 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2142.268744] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9660efe-a420-49cf-9816-be121cd9cd92" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2142.268786] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9660efe-a420-49cf-9816-be121cd9cd92" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2142.269022] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9660efe-a420-49cf-9816-be121cd9cd92" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2142.269116] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9660efe-a420-49cf-9816-be121cd9cd92',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2142.772566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9660efe-a420-49cf-9816-be121cd9cd92 [ 2142.772825] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2142.772966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2142.773058] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2142.773296] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2142.773398] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2142.773503] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9660efe-a420-49cf-9816-be121cd9cd92 already deleted. [ 2142.773594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9660efe-a420-49cf-9816-be121cd9cd92" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2143.054055] env[71051]: INFO networking_nsxv3.common.synchronization [None req-fef7ebd2-3889-4690-9d37-c5e8f5fca068 tempest-ServersTestFqdnHostnames-2076731495 tempest-ServersTestFqdnHostnames-2076731495-project-member] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2143.056923] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2143.056923] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2143.056923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2143.056923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2143.056923] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2143.056923] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2143.121250] env[71051]: INFO networking_nsxv3.common.synchronization [None req-d37ce184-19bf-49af-b8be-39e2da6c38d6 tempest-ServersTestFqdnHostnames-2076731495 tempest-ServersTestFqdnHostnames-2076731495-project-member] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2143.121749] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2143.122064] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2143.122174] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2143.576595] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2143.576934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2143.576934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2143.577303] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2143.577443] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2143.577581] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df already deleted. [ 2143.577709] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2143.577912] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2143.578172] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2143.578291] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2144.100358] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2144.100511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2144.100576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2144.100802] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2144.100898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2144.100996] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df already deleted. [ 2144.101091] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2144.144775] env[71051]: INFO networking_nsxv3.common.synchronization [None req-3c0c8eef-a738-4529-be70-836119364fba None None] Enqueued Resource ID: a977805d-a918-4590-baa1-0193679d13cf with Priority: HIGHEST for action port [ 2144.145082] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a977805d-a918-4590-baa1-0193679d13cf with Priority: HIGHEST for action port [ 2144.145669] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-a977805d-a918-4590-baa1-0193679d13cf taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2144.145796] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a977805d-a918-4590-baa1-0193679d13cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2144.145865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a977805d-a918-4590-baa1-0193679d13cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2144.146136] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a977805d-a918-4590-baa1-0193679d13cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2144.146223] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a977805d-a918-4590-baa1-0193679d13cf',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2144.648787] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a977805d-a918-4590-baa1-0193679d13cf [ 2144.649100] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2144.649176] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2144.649223] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2144.649429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2144.649521] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2144.649616] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a977805d-a918-4590-baa1-0193679d13cf already deleted. [ 2144.649696] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a977805d-a918-4590-baa1-0193679d13cf" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2145.206362] env[71051]: INFO networking_nsxv3.common.synchronization [req-6ba2c7b2-5e7d-4085-b1e2-33aaf9d28732 req-0a011a58-d07c-45da-8ec6-be49392f93f4 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2145.206894] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2145.207276] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2145.207406] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2145.207511] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2145.207856] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2145.208074] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2145.208197] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2145.208263] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2145.208429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2145.208517] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2145.208612] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2145.710635] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2146.213223] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2146.715146] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.715485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2146.715485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2146.715626] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2146.715719] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2146.715820] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2146.746611] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.746776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2146.746827] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2146.746993] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2146.747156] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2146.756201] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2148.371454] env[71051]: INFO networking_nsxv3.common.synchronization [req-24e1672c-cc0e-41b5-9aa8-001bd1bfc727 req-34bf74f9-e5d2-49c6-b860-3713cf80bbf5 tempest-ServersTestFqdnHostnames-2076731495 tempest-ServersTestFqdnHostnames-2076731495-project-member] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2148.372021] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2148.372321] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.372444] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.372509] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.372771] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.372921] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.373032] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.373090] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.373239] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.373325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.373421] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2148.621813] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.622052] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-91" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.622230] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-91" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.622527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-91" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.622794] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.622955] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.623090] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.623309] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.623462] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.623681] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2148.623805] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2148.623922] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2148.624050] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2148.624171] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2148.624285] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2148.624432] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2148.642231] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2148.642428] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2148.642544] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2148.642725] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-91" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.643042] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-ca58084d-ce65-49ef-92f8-1c6f363ce749 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.643225] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.643355] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.643650] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.643800] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca58084d-ce65-49ef-92f8-1c6f363ce749',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2148.766577] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2148.766875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.875181] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.875342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.875420] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.875634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.875727] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.875921] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2148.876034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2148.876101] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2148.876252] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2148.876328] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2148.876413] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df already deleted. [ 2148.876493] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.146994] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.146994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.146994] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.147352] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.147559] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.147669] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port ca58084d-ce65-49ef-92f8-1c6f363ce749 not found, creating... [ 2149.147957] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.148227] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.148323] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.148605] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.148777] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.149204] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.149527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.149527] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.149780] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.149990] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.150136] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: ca58084d-ce65-49ef-92f8-1c6f363ce749 is going to be created. [ 2149.168337] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.168570] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.168679] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.168932] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.169174] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.169412] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.855339] env[71051]: INFO networking_nsxv3.common.synchronization [req-24e1672c-cc0e-41b5-9aa8-001bd1bfc727 req-19e839e3-9118-4344-a83d-51fd9f6830c7 service nova] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2149.855623] env[71051]: INFO networking_nsxv3.common.synchronization [req-24e1672c-cc0e-41b5-9aa8-001bd1bfc727 req-19e839e3-9118-4344-a83d-51fd9f6830c7 service nova] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2149.855669] env[71051]: INFO networking_nsxv3.common.synchronization [req-24e1672c-cc0e-41b5-9aa8-001bd1bfc727 req-19e839e3-9118-4344-a83d-51fd9f6830c7 service nova] Enqueued Resource ID: ca58084d-ce65-49ef-92f8-1c6f363ce749 with Priority: HIGHEST for action port [ 2149.855902] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_rules [ 2149.856041] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2149.856143] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca58084d-ce65-49ef-92f8-1c6f363ce749 with Priority: HIGHEST for action port [ 2149.857319] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.857454] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.857524] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.857712] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.857795] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2149.860560] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.860768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.860858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.861053] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.861209] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.861311] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.861379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.861525] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.861637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.861757] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2149.862758] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca58084d-ce65-49ef-92f8-1c6f363ce749 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2149.862865] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2149.862934] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2149.863268] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2149.863646] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca58084d-ce65-49ef-92f8-1c6f363ce749',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2150.360990] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2150.361148] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2150.365566] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca58084d-ce65-49ef-92f8-1c6f363ce749 with status ACTIVE [ 2150.365756] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2150.365885] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2150.365955] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2150.366186] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2150.366280] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2150.366487] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2150.366566] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2150.366616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2150.366756] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2150.366835] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2150.367024] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2150.367120] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2150.367182] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2150.367378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2150.367451] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2150.367536] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca58084d-ce65-49ef-92f8-1c6f363ce749 is going to be updated. [ 2150.368798] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2150.388828] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2150.388978] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2150.389046] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2150.389247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2150.389383] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2150.389542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca58084d-ce65-49ef-92f8-1c6f363ce749" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2150.871554] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2151.374256] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2151.374484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2151.374484] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2151.374697] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2151.374790] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2151.374891] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df is going to be created. [ 2151.396055] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2151.396276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2151.396276] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2151.396485] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2151.396643] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2151.405609] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: UNINITIALIZED for 2s [ 2153.417067] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: SUCCESS [ 2153.417067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2153.417067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2153.417067] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2153.417654] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2153.417654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2153.417654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2153.417654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2153.417654] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2153.417859] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2153.417859] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2153.923297] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2154.425745] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b91f99e-d678-4cd0-8acd-4077a86f80df: rpc.has_security_group_logging(os_id): False [ 2154.444422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2154.444586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2154.444632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2154.444823] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2154.444915] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2154.445170] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2154.445266] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2154.445327] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2154.445487] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2154.445563] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2154.445651] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df is going to be created. [ 2154.505896] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2154.506127] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2154.506195] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2154.506395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2154.506581] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2154.518805] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: IN_PROGRESS for 2s [ 2154.857289] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2154.857511] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2156.534062] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: SUCCESS [ 2156.534387] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2159.858297] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2159.858652] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2162.531870] env[71051]: INFO networking_nsxv3.common.synchronization [req-a1896ccb-f0f8-4d7d-bcd3-231fc34ff913 req-30978dc9-06c0-40bb-a052-41ae4237a636 tempest-ServerActionsTestOtherA-2018127259 tempest-ServerActionsTestOtherA-2018127259-project-member] Enqueued Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2162.532344] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 with Priority: HIGHEST for action security_group_members [ 2162.532645] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-b02920d4-bbc8-495c-8ae5-4c754953cd14 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2162.532760] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2162.532826] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2162.533018] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2162.533355] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2162.533355] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2162.533600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2162.533600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2162.536189] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2162.536189] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b02920d4-bbc8-495c-8ae5-4c754953cd14',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2163.037796] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2163.038041] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2163.038121] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2163.038367] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2163.038499] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2163.038741] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2163.038853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2163.038945] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2163.039154] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2163.039247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2163.039343] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 is going to be updated. [ 2163.066158] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2163.066394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2163.066394] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2163.066565] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2163.066703] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2163.074168] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: IN_PROGRESS for 2s [ 2165.084818] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 in Status: SUCCESS [ 2165.085122] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b02920d4-bbc8-495c-8ae5-4c754953cd14 deletion is rescheduled due to dependency. [ 2165.085122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b02920d4-bbc8-495c-8ae5-4c754953cd14" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2167.533374] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2167.533374] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2169.630886] env[71051]: INFO networking_nsxv3.common.synchronization [req-94e33120-6979-41fb-ac55-9a174d1cdc51 req-5d2d94f4-c2f1-4834-bae1-75456213f075 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2169.631451] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 with Priority: HIGHEST for action security_group_members [ 2169.632083] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a5faa5-1a2a-430d-8c2c-cebc38471410 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2169.632225] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2169.632326] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2169.632586] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2169.632812] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2169.632958] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2169.633083] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2169.633288] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2169.633384] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2169.633478] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a5faa5-1a2a-430d-8c2c-cebc38471410',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2170.136454] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2170.136615] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2170.136688] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2170.136884] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2170.136979] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2170.137192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2170.137293] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2170.137351] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2170.137501] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2170.137578] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2170.137684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 is going to be updated. [ 2170.163176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2170.163358] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2170.163409] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2170.163595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2170.163732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2170.175855] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: IN_PROGRESS for 2s [ 2172.186518] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 in Status: SUCCESS [ 2172.186931] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a5faa5-1a2a-430d-8c2c-cebc38471410 deletion is rescheduled due to dependency. [ 2172.186931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a5faa5-1a2a-430d-8c2c-cebc38471410" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2174.632480] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2174.632844] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2176.633542] env[71051]: INFO networking_nsxv3.common.synchronization [None req-cc65fcdc-6338-4b2b-8165-4444f5cc9b29 tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2176.634101] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2176.634410] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.634537] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2176.634604] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2176.634853] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2176.634942] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2176.698764] env[71051]: INFO networking_nsxv3.common.synchronization [None req-7e01d9ef-fddd-493a-ad4c-a734c04aff1b tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2176.700284] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2176.700284] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.700284] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2177.157047] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2177.157047] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 already deleted. [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2177.157047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2177.157535] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2177.157535] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2177.675422] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2177.675788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2177.675788] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2177.675867] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2177.675902] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2177.676049] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 already deleted. [ 2177.676116] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2181.700433] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2181.700433] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2181.931144] env[71051]: INFO networking_nsxv3.common.synchronization [req-cfa19a95-d40a-446f-83ca-90d90fcca494 req-f64eda4b-cad4-4f81-b439-4eb6a96b516f tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2181.932076] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2181.932466] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2181.932596] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2181.932664] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2181.932906] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2181.933117] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2181.933254] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2181.933309] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2181.933459] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2181.933538] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2181.933626] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2182.210675] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.210876] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.211016] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.211294] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.211556] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.211720] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.212418] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.212723] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.212929] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.213206] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2182.213367] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2182.213516] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2182.213663] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2182.213872] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2182.213965] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2182.214150] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2182.234547] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2182.234547] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2182.234547] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2182.234547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-428" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.235036] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-28667aea-02a0-4284-bd54-8d778dd41437 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.235266] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.235426] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.235793] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.236163] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28667aea-02a0-4284-bd54-8d778dd41437',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2182.435932] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.436151] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.436224] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.436429] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.436522] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.436767] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.436877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.436933] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.437092] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.437171] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.437258] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 already deleted. [ 2182.437340] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.739072] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.739511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.739511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.739640] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.739729] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.739894] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 28667aea-02a0-4284-bd54-8d778dd41437 not found, creating... [ 2182.740205] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.740395] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.740524] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.740753] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.740938] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.741272] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.741511] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.741692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.741990] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.742213] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.742470] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 28667aea-02a0-4284-bd54-8d778dd41437 is going to be created. [ 2182.763414] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2182.763635] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2182.763763] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2182.764045] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2182.764289] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2182.764536] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.445654] env[71051]: INFO networking_nsxv3.common.synchronization [req-cfa19a95-d40a-446f-83ca-90d90fcca494 req-1b2d7949-0c73-4289-874b-d6f08ad7a2cb service nova] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2183.445872] env[71051]: INFO networking_nsxv3.common.synchronization [req-cfa19a95-d40a-446f-83ca-90d90fcca494 req-1b2d7949-0c73-4289-874b-d6f08ad7a2cb service nova] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2183.446049] env[71051]: INFO networking_nsxv3.common.synchronization [req-cfa19a95-d40a-446f-83ca-90d90fcca494 req-1b2d7949-0c73-4289-874b-d6f08ad7a2cb service nova] Enqueued Resource ID: 28667aea-02a0-4284-bd54-8d778dd41437 with Priority: HIGHEST for action port [ 2183.446289] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_rules [ 2183.446418] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2183.446515] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28667aea-02a0-4284-bd54-8d778dd41437 with Priority: HIGHEST for action port [ 2183.447131] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.447290] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.447413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.447634] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.447746] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2183.448604] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.448752] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.448848] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.449107] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.449332] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.449475] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.449560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.449732] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.449858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.449973] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2183.450734] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-28667aea-02a0-4284-bd54-8d778dd41437 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.450877] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.450971] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.451161] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.451275] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28667aea-02a0-4284-bd54-8d778dd41437',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2183.954166] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.954411] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.954596] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28667aea-02a0-4284-bd54-8d778dd41437 with status ACTIVE [ 2183.955392] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.955392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.955392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.955392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.955392] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.955693] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.955693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.955781] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.955965] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.956066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.956290] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.956416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.956496] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.956660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.956759] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.956867] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28667aea-02a0-4284-bd54-8d778dd41437 is going to be updated. [ 2183.958039] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2183.979034] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2183.979184] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2183.979228] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2183.979385] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2183.979506] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2183.979657] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28667aea-02a0-4284-bd54-8d778dd41437" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2184.459902] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2184.961841] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2184.962159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2184.962159] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2184.962337] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2184.962469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2184.962524] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 is going to be created. [ 2184.977098] env[71051]: INFO networking_nsxv3.common.synchronization [req-877933fa-0a80-4aad-a22c-ecc746eae21e req-9fa1539f-0543-4488-b608-951436974a0c tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2184.977183] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2184.977643] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2184.977775] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2184.977844] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2184.978208] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2184.978369] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2184.978427] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2184.978463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2184.978600] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2184.978681] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2184.978778] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2184.985682] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2184.986931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2184.986931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2184.986931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2184.986931] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2184.995611] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: UNINITIALIZED for 2s [ 2185.481461] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2185.481665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2185.481665] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2185.481892] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2185.482015] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2185.482249] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2185.482353] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2185.482431] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2185.482597] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2185.482693] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2185.482784] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2185.517279] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2185.517465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2185.517465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2185.517580] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2185.517715] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2185.524948] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2187.006021] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: SUCCESS [ 2187.006356] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2187.006466] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2187.006619] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2187.006803] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2187.006916] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2187.006985] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2187.007130] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2187.007238] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2187.007305] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2187.007379] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2187.509929] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2187.535217] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2187.535450] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e deletion is rescheduled due to dependency. [ 2187.535523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2188.012325] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 958e639c-c4ee-4d75-aee0-4e6868134cb6: rpc.has_security_group_logging(os_id): False [ 2188.028765] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2188.028930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2188.028996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2188.029198] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2188.029285] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2188.029534] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2188.029637] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2188.029699] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2188.029852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2188.029930] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2188.030029] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 is going to be created. [ 2188.086192] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2188.086334] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2188.086378] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2188.086542] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2188.086716] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2188.095747] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: IN_PROGRESS for 2s [ 2189.978252] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2189.978556] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2190.109235] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: SUCCESS [ 2190.109413] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2194.636816] env[71051]: INFO networking_nsxv3.common.synchronization [req-39ce76a7-95cb-4f2e-848a-81a58f55c48a req-362e50b3-308e-4e7e-9ddf-7e9522b5278c tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2194.637386] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2194.637692] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2194.638043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2194.638043] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2194.638209] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2194.638373] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2194.638507] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2194.638550] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2194.638682] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2194.638768] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2194.638861] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2194.942313] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2194.942600] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2194.942775] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2194.943122] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2194.943451] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2194.943649] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2194.944036] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2194.944205] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2194.944409] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2194.944663] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2194.944818] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] NeedRegenerationException {{(pid=71051) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2194.944953] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] no value, waiting for create lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2194.945115] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] value creation lock acquired {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2194.945270] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] No value present for key: 'zone-id' {{(pid=71051) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2194.945404] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Calling creation function for not-yet-present value {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2194.945552] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2194.963974] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2194.964172] env[71051]: DEBUG dogpile.cache.region [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71051) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2194.964343] env[71051]: DEBUG dogpile.lock [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Released creation lock {{(pid=71051) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2194.964542] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "network-740" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2194.964864] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock port-2c62ae61-38d8-4515-881f-9cf14d53dec4 taken with stack trace [, , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2194.965078] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2194.965241] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2194.965559] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2194.965734] env[71051]: DEBUG networking_nsxv3.api.rpc [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c62ae61-38d8-4515-881f-9cf14d53dec4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2195.140747] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.140954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.140954] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.141183] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.141287] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.141491] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.141594] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.141656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.141812] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.141888] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.141975] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2195.165808] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.165966] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.166023] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.166185] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.166317] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.174313] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2195.468151] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.468411] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.468547] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.468833] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.468988] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.469165] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Segment Port 2c62ae61-38d8-4515-881f-9cf14d53dec4 not found, creating... [ 2195.469451] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.469618] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.469742] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.469963] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.470118] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.470409] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.470567] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.470692] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.470904] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.471054] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.471202] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Resource: SegmentPort with ID: 2c62ae61-38d8-4515-881f-9cf14d53dec4 is going to be created. [ 2195.490595] env[71051]: DEBUG networking_nsxv3.common.locking [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.490798] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.490942] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.491197] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.491432] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.491689] env[71051]: DEBUG oslo_concurrency.lockutils [None req-f9e762ba-a1c1-4a66-8457-519a4cad99c7 None None] Releasing lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.681734] env[71051]: INFO networking_nsxv3.common.synchronization [req-8775c67e-6261-4d83-969d-0e78086f5a18 req-c5092a80-c100-43f2-9e3a-84bb4bcea0f0 tempest-ServersTestFqdnHostnames-2076731495 tempest-ServersTestFqdnHostnames-2076731495-project-member] Enqueued Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2195.682413] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df with Priority: HIGHEST for action security_group_members [ 2195.682594] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b91f99e-d678-4cd0-8acd-4077a86f80df taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.682713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.682864] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.682976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.683226] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2195.683342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2195.683342] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2195.683465] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2195.683520] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2195.683605] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b91f99e-d678-4cd0-8acd-4077a86f80df',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2196.145094] env[71051]: INFO networking_nsxv3.common.synchronization [req-39ce76a7-95cb-4f2e-848a-81a58f55c48a req-c5751080-f14c-4aa7-ba59-4662232623f6 service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 2196.145334] env[71051]: INFO networking_nsxv3.common.synchronization [req-39ce76a7-95cb-4f2e-848a-81a58f55c48a req-c5751080-f14c-4aa7-ba59-4662232623f6 service nova] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2196.145508] env[71051]: INFO networking_nsxv3.common.synchronization [req-39ce76a7-95cb-4f2e-848a-81a58f55c48a req-c5751080-f14c-4aa7-ba59-4662232623f6 service nova] Enqueued Resource ID: 2c62ae61-38d8-4515-881f-9cf14d53dec4 with Priority: HIGHEST for action port [ 2196.145677] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_rules [ 2196.145803] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2196.145895] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c62ae61-38d8-4515-881f-9cf14d53dec4 with Priority: HIGHEST for action port [ 2196.146425] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.146545] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.146616] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.146809] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.146888] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2196.147946] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.148070] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.148255] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c62ae61-38d8-4515-881f-9cf14d53dec4 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.148360] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.148415] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.148623] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.148623] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c62ae61-38d8-4515-881f-9cf14d53dec4',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2196.185630] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.185776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.185776] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.185964] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.186066] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.186274] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.186375] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.186435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.186585] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.186661] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.186741] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df is going to be updated. [ 2196.212328] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.212469] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.212513] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.212660] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.212789] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.222042] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: IN_PROGRESS for 2s [ 2196.650947] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.651192] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.651353] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c62ae61-38d8-4515-881f-9cf14d53dec4 with status ACTIVE [ 2196.651475] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.651590] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.651656] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.651875] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.651967] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.652156] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.652256] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.652313] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.652471] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.652549] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.652727] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.652819] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.652881] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.653033] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.653109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.653193] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c62ae61-38d8-4515-881f-9cf14d53dec4 is going to be updated. [ 2196.672776] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2196.672951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2196.672951] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2196.673117] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2196.673246] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2196.673395] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c62ae61-38d8-4515-881f-9cf14d53dec4" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2197.185595] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2197.185849] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e deletion is rescheduled due to dependency. [ 2197.185893] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2197.186047] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2197.186299] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2197.186486] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2197.186630] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2197.186680] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2197.186816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2197.186898] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2197.186995] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2197.689144] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2198.191749] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2198.230716] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df in Status: SUCCESS [ 2198.230913] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b91f99e-d678-4cd0-8acd-4077a86f80df deletion is rescheduled due to dependency. [ 2198.231016] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b91f99e-d678-4cd0-8acd-4077a86f80df" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2198.695305] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2198.695523] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2198.695595] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2198.695764] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2198.695858] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2198.695962] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2198.723158] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2198.723364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2198.723364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2198.723512] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2198.723653] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2198.731129] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2200.742214] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2200.742562] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2200.742684] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2200.742987] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2200.743280] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2200.743463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2200.743576] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2200.743816] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2200.743957] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2200.744122] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2200.744306] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2201.147375] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2201.147375] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2201.247133] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2201.750078] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2340689e-da3e-4aee-87d6-1ef7d8ca959e: rpc.has_security_group_logging(os_id): False [ 2201.766889] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2201.767132] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2201.767204] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2201.767449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2201.767560] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2201.767855] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2201.767997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2201.768109] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2201.768321] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2201.768435] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2201.768544] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2201.827800] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2201.827947] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2201.828054] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2201.828379] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2201.828533] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2201.844467] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2203.859034] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2203.859449] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2206.148500] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2206.148967] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2211.150411] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2211.150411] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2216.151801] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2216.152231] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2221.153657] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2221.154121] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2226.155318] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2226.155695] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2231.156312] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2231.156569] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2236.157399] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2236.157718] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2241.158758] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2241.159097] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2244.588670] env[71051]: INFO networking_nsxv3.common.synchronization [req-10e33586-6f38-4364-bc9c-757348668a1d req-c6d41667-a4c9-4bbc-aa21-1a948c30ac1e tempest-AttachVolumeNegativeTest-565180346 tempest-AttachVolumeNegativeTest-565180346-project-member] Enqueued Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2244.589766] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 with Priority: HIGHEST for action security_group_members [ 2244.590164] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-958e639c-c4ee-4d75-aee0-4e6868134cb6 taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2244.590364] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2244.590632] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2244.590705] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2244.590856] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2244.590997] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2244.591086] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2244.591298] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2244.591416] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2244.591532] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958e639c-c4ee-4d75-aee0-4e6868134cb6',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2245.096683] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2245.096996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2245.096996] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2245.097215] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2245.097323] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2245.097537] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2245.097646] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2245.097720] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2245.097852] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2245.097926] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2245.098034] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 is going to be updated. [ 2245.126512] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2245.126713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2245.126713] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2245.126840] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2245.126976] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2245.134684] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: IN_PROGRESS for 2s [ 2247.146935] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 in Status: SUCCESS [ 2247.146935] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958e639c-c4ee-4d75-aee0-4e6868134cb6 deletion is rescheduled due to dependency. [ 2247.146935] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958e639c-c4ee-4d75-aee0-4e6868134cb6" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2249.591296] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2249.591672] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2254.592058] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2254.592332] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2259.057536] env[71051]: INFO networking_nsxv3.common.synchronization [req-3a1e25fd-da9f-4719-889c-3325343b11a7 req-b8520b5e-c7d5-4c31-9bb3-96994b987e91 tempest-ServerActionsTestJSON-1725955929 tempest-ServerActionsTestJSON-1725955929-project-member] Enqueued Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2259.057536] env[71051]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e with Priority: HIGHEST for action security_group_members [ 2259.057536] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock member-2340689e-da3e-4aee-87d6-1ef7d8ca959e taken with stack trace [, , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2259.057536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2259.057536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2259.057536] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2259.057975] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2259.057975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2259.057975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2259.057975] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2259.058124] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2259.058124] env[71051]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2340689e-da3e-4aee-87d6-1ef7d8ca959e',) {} {{(pid=71051) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2259.562176] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2259.562361] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2259.562491] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2259.562640] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2259.562735] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2259.562934] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2259.563034] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2259.563098] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2259.563247] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2259.563325] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2259.563533] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e is going to be updated. [ 2259.590184] env[71051]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2259.590463] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2259.590611] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2259.590779] env[71051]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2259.590914] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2259.598267] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: IN_PROGRESS for 2s [ 2261.609416] env[71051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e in Status: SUCCESS [ 2261.609738] env[71051]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2340689e-da3e-4aee-87d6-1ef7d8ca959e deletion is rescheduled due to dependency. [ 2261.609821] env[71051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2340689e-da3e-4aee-87d6-1ef7d8ca959e" {{(pid=71051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2264.057737] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2264.058016] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2269.058764] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2269.059155] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2274.060691] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2274.061065] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2279.062099] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2279.062449] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2284.063768] env[71051]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2284.064697] env[71051]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0